00000001:02000400:2.0F:1790656326.493949:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1790656343.692336:0:3176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790656345.412582:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 491 MB/s 00000001:01000000:3.0:1790656345.663238:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 971 MB/s 00000001:01000000:1.0:1790656345.913509:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6751 MB/s 00000020:02000000:3.0:1790656346.712833:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g5548f20 00000400:02000000:2.0:1790656347.765993:0:3283:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.123@tcp [8/256/0/180] 00008000:02000000:0.0F:1790656351.582713:0:3432:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1790656402.087221:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790656411.215430:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790656411.215436:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790656411.215542:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c66d5f96 00000080:02000400:1.0:1790656411.215552:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1790656411.222314:0:5824:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790656411.222325:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790656411.222361:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000067b4760e) 00000020:00000080:1.0:1790656411.222381:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790656411.262959:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790656411.264470:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790656411.331070:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790656411.331108:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790656411.331130:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790656411.331181:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790656411.331206:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790656411.331538:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790656411.331546:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790656411.331554:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea7cb 00000020:01000004:3.0:1790656411.331561:0:5824:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790656411.331565:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790656411.331569:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c66d5f96 from MGS 00000020:01000004:3.0:1790656411.331573:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790656411.331613:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000680e5886) 00000020:00000080:3.0:1790656411.331624:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790656411.331703:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c66d5f96 from MGS, refs=2 00080000:01000000:3.0:1790656411.331709:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790656411.331714:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea7d9 00000100:00100000:3.0:1790656411.331794:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790656411.331914:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790656411.331919:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790656411.341582:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790656411.341684:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790656411.342787:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790656411.343250:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790656411.343258:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790656411.343997:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790656411.344066:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790656411.344735:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790656411.344741:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790656411.346542:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656411.346547:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656411.346549:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656411.347007:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656411.347016:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656411.347017:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656411.347923:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790656411.352723:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790656411.597629:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3963 MB/s 00000001:01000000:3.0:1790656411.847627:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7559 MB/s 00000001:01000000:2.0:1790656412.105054:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 797 MB/s 00000001:01000000:0.0:1790656412.355801:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 565 MB/s 00080000:10000000:0.0:1790656412.374764:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1790656412.384552:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790656412.404566:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790656412.404586:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790656412.404621:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790656412.408676:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790656412.408765:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790656412.408827:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790656412.409062:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790656412.409090:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790656412.409466:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656412.409800:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790656412.409809:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790656412.418425:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790656412.418436:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790656412.419805:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790656412.419815:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790656412.423528:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790656412.423550:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:1.0:1790656412.423552:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790656412.423624:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:1.0:1790656412.423635:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (00000000c556180f) 00000020:00000080:1.0:1790656412.423663:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790656412.423781:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006813f56c@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1790656412.423955:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:1.0:1790656412.423968:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790656412.424516:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790656412.427904:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790656412.428556:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid 4906672e-e41b-4f99-9a3c-531aeecaa79a) 00000020:00000080:1.0:1790656412.428657:0:5824:0:(genops.c:1384:class_connect()) connect: client 4906672e-e41b-4f99-9a3c-531aeecaa79a, cookie 0x9c3a6e82066ea7e7 00000100:00080000:1.0:1790656412.428671:0:5824:0:(import.c:545:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790656412.428681:0:5824:0:(import.c:666:import_select_connection()) MGC192.168.203.123@tcp: import 000000006813f56c using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656412.428747:0:5824:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f6812901 x1877639269712000/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790656412.428767:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4906672e-e41b-4f99-9a3c-531aeecaa79a->MGS 00000020:01000004:1.0:1790656412.428785:0:5824:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790656412.428808:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790656412.428821:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000001df8f9ba) 00000020:00000080:1.0:1790656412.428832:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790656412.429220:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6812901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4906672e-e41b-4f99-9a3c-531aeecaa79a:3298:1877639269712000:0@lo:250: 00000100:00100000:0.0:1790656412.429286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656412.429354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712000 00000100:00100000:0.0:1790656412.429361:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712000 00000100:00100000:0.0:1790656412.429397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656412.429403:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004531ac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1877639269712000:12345-0@lo:250: 00010000:00080000:0.0:1790656412.429420:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4906672e-e41b-4f99-9a3c-531aeecaa79a@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1790656412.429439:0:5836:0:(genops.c:1384:class_connect()) connect: client 4906672e-e41b-4f99-9a3c-531aeecaa79a, cookie 0x9c3a6e82066ea7f5 00000100:00080000:0.0:1790656412.429579:0:5836:0:(import.c:65:import_set_state_nolock()) 00000000765b295f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656412.429659:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004531ac2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:3298:x1877639269712000:12345-0@lo:250: Request processed in 254us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656412.429667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656412.429810:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790656412.429819:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:0.0:1790656412.429824:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790656412.429829:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790656412.429831:0:3298:0:(import.c:65:import_set_state_nolock()) 000000006813f56c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790656412.429834:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790656412.429842:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790656412.429846:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6812901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4906672e-e41b-4f99-9a3c-531aeecaa79a:3298:1877639269712000:0@lo:250: 00000100:00100000:1.0:1790656412.448183:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790656412.448406:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790656412.448413:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790656412.453784:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790656412.453795:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790656412.455771:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790656412.455784:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790656412.458337:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656412.458511:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790656412.458517:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790656412.459332:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790656412.459340:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790656412.528083:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656412.528276:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790656412.528282:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790656412.536980:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790656412.536994:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790656412.537707:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656412.537893:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656412.537898:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790656412.542671:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656412.542683:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790656412.546905:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656412.547086:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656412.547092:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790656412.552127:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656412.552139:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790656412.552771:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656412.552944:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656412.552949:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790656412.560462:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656412.560481:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790656412.617448:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656412.621155:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790656412.621177:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790656412.625473:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790656412.625487:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790656412.626186:0:5824:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790656412.626193:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790656412.627524:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790656412.627547:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790656412.627558:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790656412.627724:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790656412.627760:0:5824:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790656412.627764:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790656412.627765:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790656412.627767:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656412.627768:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656412.627769:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656412.627770:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656412.627771:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790656412.627772:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790656412.627774:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790656412.627775:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790656412.627776:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656412.627777:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790656412.627779:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790656412.627782:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790656412.627783:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790656412.627784:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656412.627785:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656412.627786:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656412.627787:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656412.627788:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790656412.627789:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790656412.627790:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790656412.627791:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790656412.627792:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656412.627793:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790656412.627821:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790656412.627837:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1399fd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712128:0@lo:253: 00000100:00100000:3.0:1790656412.627903:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656412.627949:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca5069d0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656412.629000:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712128 00000100:00100000:0.0:1790656412.629010:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712128 00000100:00100000:0.0:1790656412.629060:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656412.629068:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b1c979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:5824:x1877639269712128:12345-0@lo:253: 20000000:01000000:0.0:1790656412.629126:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790656412.629129:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790656412.629834:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790656412.629890:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1790656412.630138:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656412.631137:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790656412.631380:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790656412.631384:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790656412.631389:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790656412.631399:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790656412.631417:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790656412.631583:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656412.632031:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790656412.632043:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790656412.632089:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790656412.632134:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790656412.632170:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790656412.632277:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790656412.632287:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790656412.632328:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790656412.632335:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790656412.632368:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790656412.632375:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790656412.632404:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790656412.632451:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790656412.632490:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790656412.632495:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790656412.632508:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656412.632743:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790656412.632753:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790656412.632785:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790656412.632817:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790656412.632875:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790656412.632887:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790656412.632957:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790656412.632965:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790656412.633008:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790656412.633044:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790656412.633077:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790656412.633087:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790656412.633167:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790656412.633184:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790656412.633217:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790656412.637250:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790656412.637503:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790656412.637555:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790656412.637563:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790656412.646755:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790656412.647084:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790656412.647110:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.123@tcp for mdt 20000000:01000000:0.0:1790656412.647112:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1790656412.647140:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790656412.647147:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790656412.647171:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790656412.647178:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1790656412.647229:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790656412.647239:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790656412.647287:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790656412.647319:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790656412.647374:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790656412.647377:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790656412.647382:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790656412.647388:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790656412.647952:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1790656412.648044:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790656412.665197:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790656412.665254:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1790656412.665325:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1790656412.665343:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790656412.665346:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790656412.665349:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790656412.665361:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790656412.665364:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790656412.665408:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790656412.665410:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790656412.666114:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1790656412.666350:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1790656412.666392:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1790656412.666453:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1790656412.666467:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790656412.666468:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790656412.668048:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790656412.668349:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790656412.668396:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790656412.668430:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1790656412.668446:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790656412.668448:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1790656412.668455:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790656412.668473:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668488:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668497:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668502:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668508:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668525:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668531:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fd09ced already unused, calling callback (00000000f8490746) 00010000:00010000:3.0:1790656412.668535:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668542:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668554:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668561:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.668566:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea7fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790656412.668581:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790656412.899692:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b1c979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:5824:x1877639269712128:12345-0@lo:253: Request processed in 270618us (271782us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656412.899712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656412.899812:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1399fd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712128:0@lo:253: 10000000:01000000:0.0:1790656412.899836:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790656412.899839:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790656412.899841:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790656412.899843:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656412.899844:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790656412.899845:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656412.899846:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656412.899847:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790656412.899849:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790656412.899850:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790656412.899851:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656412.899853:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790656412.899869:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c66d5f96 from lustre-MDT0000 10000000:01000000:0.0:1790656412.899892:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790656412.899894:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790656412.899898:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94390a368000 10000000:01000000:0.0:1790656412.899903:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790656412.899909:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94390a368000 from 1 10000000:01000000:0.0:1790656412.899912:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790656412.899968:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656412.899979:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656412.899987:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656412.900004:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065a49f63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712256:0@lo:101: 00000100:00100000:0.0:1790656412.900047:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656412.900110:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000756e1bbc going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.900221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712256 00000100:00100000:3.0:1790656412.900227:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712256 00000100:00100000:3.0:1790656412.900266:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656412.900273:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ec2007c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:5824:x1877639269712256:12345-0@lo:101: 00010000:00010000:3.0:1790656412.900285:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656412.900297:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea803 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.900326:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.900336:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006fd09ced/0x9c3a6e82066ea80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.900344:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006fd09ced, rc 0) 00000100:00100000:3.0:1790656412.900386:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ec2007c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5824:x1877639269712256:12345-0@lo:101: Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656412.900392:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656412.900468:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065a49f63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712256:0@lo:101: 00010000:00010000:2.0:1790656412.900479:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.900486:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656412.900538:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712384:0@lo:501: 00000100:00100000:2.0:1790656412.900576:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.900626:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016bb3de0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.900691:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712384 00000100:00100000:3.0:1790656412.900695:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712384 00000100:00100000:3.0:1790656412.900724:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656412.900730:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dfdd97c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5824:x1877639269712384:12345-0@lo:501: 00000100:00100000:3.0:1790656412.900949:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dfdd97c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5824:x1877639269712384:12345-0@lo:501: Request processed in 219us (372us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790656412.900957:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656412.901089:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712384:0@lo:501: 10000000:01000000:2.0:1790656412.901112:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790656412.901132:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901140:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000efdbd0b6/0x9c3a6e82066ea803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656412.901147:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff943928721000 10000000:01000000:2.0:1790656412.901150:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790656412.901154:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff943928721000 10000000:01000000:2.0:1790656412.901156:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790656412.901158:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff943928721000 from 1 10000000:01000000:2.0:1790656412.901160:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790656412.901177:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901184:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901191:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656412.901202:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712512:0@lo:101: 00000100:00100000:2.0:1790656412.901226:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.901237:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016bb3de0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.901293:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712512 00000100:00100000:3.0:1790656412.901298:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712512 00000100:00100000:3.0:1790656412.901326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656412.901332:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e57fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5824:x1877639269712512:12345-0@lo:101: 00010000:00010000:3.0:1790656412.901339:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656412.901348:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f02f5ff3/0x9c3a6e82066ea818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea811 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.901362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f02f5ff3/0x9c3a6e82066ea818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea811 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.901381:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f02f5ff3/0x9c3a6e82066ea818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea811 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656412.901387:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f02f5ff3, rc 0) 00000100:00100000:3.0:1790656412.901413:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e57fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:5824:x1877639269712512:12345-0@lo:101: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656412.901419:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656412.901532:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712512:0@lo:101: 00010000:00010000:2.0:1790656412.901542:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901558:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656412.901569:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790656412.901584:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901619:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000000da80f1e/0x9c3a6e82066ea811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656412.901625:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790656412.901629:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656412.901633:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff943928721000 10000000:01000000:2.0:1790656412.901644:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790656412.901648:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790656412.901650:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790656412.901664:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901670:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.901675:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656412.901685:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712640:0@lo:101: 00000100:00100000:2.0:1790656412.901708:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.901728:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016bb3de0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656412.901788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712640 00000100:00100000:0.0:1790656412.901792:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712640 00000100:00100000:0.0:1790656412.901831:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656412.901837:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024350db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:5824:x1877639269712640:12345-0@lo:101: 00010000:00010000:0.0:1790656412.901844:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656412.901851:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008424d78/0x9c3a6e82066ea826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea81f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656412.901865:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008424d78/0x9c3a6e82066ea826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656412.901872:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008424d78/0x9c3a6e82066ea826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656412.901877:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008424d78, rc 0) 00000100:00100000:0.0:1790656412.901909:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024350db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+8:5824:x1877639269712640:12345-0@lo:101: Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656412.901916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656412.902077:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712640:0@lo:101: 00010000:00010000:2.0:1790656412.902087:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656412.902094:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656412.902128:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712768:0@lo:501: 00000100:00100000:2.0:1790656412.902152:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.902171:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016bb3de0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.902220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712768 00000100:00100000:3.0:1790656412.902225:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712768 00000100:00100000:3.0:1790656412.902251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790656412.902257:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c4bb6ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+8:5824:x1877639269712768:12345-0@lo:501: 00000100:00100000:3.0:1790656412.902434:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c4bb6ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5824:x1877639269712768:12345-0@lo:501: Request processed in 177us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656412.902441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790656412.902510:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712768:0@lo:501: 00000100:00100000:2.0:1790656412.902535:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712896:0@lo:503: 00000100:00100000:2.0:1790656412.902571:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.902617:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016bb3de0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.902673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269712896 00000100:00100000:3.0:1790656412.902678:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269712896 00000100:00100000:3.0:1790656412.902707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790656412.902713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cccb862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5824:x1877639269712896:12345-0@lo:503: 00000100:00100000:3.0:1790656412.902916:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cccb862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5824:x1877639269712896:12345-0@lo:503: Request processed in 203us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656412.902922:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656412.903034:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269712896:0@lo:503: 00000100:00100000:2.0:1790656412.903389:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5866:1877639269713024:0@lo:502: 00000100:00100000:2.0:1790656412.903427:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656412.903453:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 000000008bb54909 going to sleep for 11 seconds 00000100:00100000:3.0:1790656412.903503:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713024 00000100:00100000:3.0:1790656412.903508:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713024 00000100:00100000:3.0:1790656412.903539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790656412.903545:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083748c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5866:x1877639269713024:12345-0@lo:502: 00000100:00100000:2.0:1790656412.904021:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083748c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5866:x1877639269713024:12345-0@lo:502: Request processed in 476us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656412.904042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656412.904168:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000893dbd8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5866:1877639269713024:0@lo:502: 00000020:01000000:0.0:1790656412.904195:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656412.904205:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656412.904207:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790656412.904214:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790656412.904217:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656412.904237:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d4d80047) 00000020:00000080:0.0:1790656412.904255:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790656412.904263:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790656412.904339:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790656412.904347:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea834 00000020:00000080:0.0:1790656412.904552:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790656412.904557:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656412.904560:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656412.904562:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790656412.904565:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656412.904568:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656412.904569:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790656412.904572:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656412.904576:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004e2dc496) 00000020:00000080:0.0:1790656412.904585:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790656412.904669:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790656412.904672:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790656412.904675:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790656412.904682:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790656412.904727:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c66d5f96 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790656412.904737:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004dabb400) 00000020:00000080:0.0:1790656412.904744:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790656412.904806:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790656412.904812:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ea849 00000020:00000080:0.0:1790656412.904985:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790656412.904992:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790656412.904996:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c3a6e82066ea850 00080000:01000000:0.0:1790656412.905001:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790656412.905004:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea857 00080000:10000000:0.0:1790656412.905391:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1790656412.905764:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790656412.910311:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790656412.987438:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790656412.987976:0:5866:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790656412.991553:0:5866:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790656412.991982:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790656413.033504:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000381bd5c4) 00000020:00000080:2.0:1790656413.033527:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790656413.033662:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790656413.033670:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea865 00000020:00000080:0.0:1790656413.034309:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1790656413.035958:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.078493:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656413.113300:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.144958:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.170525:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.200320:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1790656413.244120:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c3a6e82066ea86c 00000020:00000080:2.0:1790656413.244497:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790656413.244507:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656413.244518:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656413.244520:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790656413.244524:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656413.244530:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656413.244531:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790656413.244535:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790656413.244571:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790656413.244585:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656413.244588:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656413.244606:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790656413.244609:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656413.244612:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656413.244613:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790656413.244616:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790656413.244617:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790656413.244827:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f73985a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5866:1877639269713152:0@lo:502: 00000100:00100000:2.0:1790656413.244899:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656413.244954:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fcc43ce going to sleep for 11 seconds 00000100:00100000:1.0:1790656413.245024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713152 00000100:00100000:1.0:1790656413.245031:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713152 00000100:00100000:1.0:1790656413.245083:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790656413.245091:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000edf6033e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5866:x1877639269713152:12345-0@lo:502: 00000100:00100000:1.0:1790656413.245517:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000edf6033e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5866:x1877639269713152:12345-0@lo:502: Request processed in 426us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656413.245524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656413.246082:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f73985a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5866:1877639269713152:0@lo:502: 00000020:01000000:2.0:1790656413.246112:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656413.246118:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656413.246120:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790656413.246124:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790656413.246383:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790656413.246400:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790656413.246419:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.246437:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000cda980ce/0x9c3a6e82066ea81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656413.246444:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943928721000 from 1 10000000:01000000:1.0:1790656413.246456:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790656413.246487:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.246494:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.246503:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656413.246518:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000841c7688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713280:0@lo:101: 00000100:00100000:1.0:1790656413.246551:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656413.246573:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c99efb4 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.246883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713280 00000100:00100000:2.0:1790656413.246890:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713280 00000100:00100000:2.0:1790656413.246921:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656413.246928:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001076740d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:5824:x1877639269713280:12345-0@lo:101: 00010000:00010000:2.0:1790656413.246940:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656413.246953:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea873 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.246983:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.246992:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.247000:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ceb0382b, rc 0) 00000100:00100000:2.0:1790656413.247030:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001076740d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:5824:x1877639269713280:12345-0@lo:101: Request processed in 103us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.247035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790656413.247231:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000841c7688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713280:0@lo:101: 00010000:00010000:1.0:1790656413.247244:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.247251:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656413.248249:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000841c7688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713408:0@lo:256: 00000100:00100000:1.0:1790656413.248301:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656413.248381:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c99efb4 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.249265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713408 00000100:00100000:2.0:1790656413.249274:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713408 00000100:00100000:2.0:1790656413.249309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656413.249316:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000854b2517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:5824:x1877639269713408:12345-0@lo:256: 20000000:01000000:2.0:1790656413.249347:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790656413.249353:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790656413.249990:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000854b2517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:5824:x1877639269713408:12345-0@lo:256: Request processed in 672us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.249999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790656413.250025:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000841c7688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713408:0@lo:256: 10000000:01000000:0.0:1790656413.250760:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790656413.250781:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.250794:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656413.250801:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943928721000 from 1 10000000:01000000:0.0:1790656413.250803:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790656413.250833:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.250840:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.250848:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656413.250865:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fce81772 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713536:0@lo:101: 00000100:00100000:0.0:1790656413.250900:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.250942:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019c382b7 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.251141:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713536 00000100:00100000:2.0:1790656413.251147:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713536 00000100:00100000:2.0:1790656413.251183:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656413.251189:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042844d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:5824:x1877639269713536:12345-0@lo:101: 00010000:00010000:2.0:1790656413.251200:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656413.251210:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea881 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.251242:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.251251:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656413.251259:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f8173dc, rc 0) 00000100:00100000:2.0:1790656413.251302:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042844d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713536:12345-0@lo:101: Request processed in 114us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.251308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790656413.251384:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fce81772 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713536:0@lo:101: 00010000:00010000:3.0:1790656413.251398:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.251416:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656413.251584:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713664:0@lo:501: 00000100:00100000:3.0:1790656413.251717:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656413.251737:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4a78ec6 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.251915:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713664 00000100:00100000:2.0:1790656413.251920:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713664 00000100:00100000:2.0:1790656413.251944:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656413.251949:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008560ef90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713664:12345-0@lo:501: 00000100:00100000:2.0:1790656413.253984:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008560ef90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713664:12345-0@lo:501: Request processed in 2030us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.253996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790656413.254350:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713664:0@lo:501: 00000100:00100000:3.0:1790656413.254565:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713792:0@lo:503: 00000100:00100000:3.0:1790656413.254668:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656413.254703:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4a78ec6 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.254861:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713792 00000100:00100000:2.0:1790656413.254868:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713792 00000100:00100000:2.0:1790656413.254906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656413.254913:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002058ed21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713792:12345-0@lo:503: 00000040:00080000:2.0:1790656413.254957:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790656413.255001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002058ed21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713792:12345-0@lo:503: Request processed in 88us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.255008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656413.255205:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713792:0@lo:503: 00000040:00080000:3.0:1790656413.258340:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790656413.258645:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790656413.258667:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790656413.258682:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.258694:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656413.258749:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790656413.258752:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff943928721000 10000000:01000000:0.0:1790656413.258754:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff943928721000 10000000:01000000:0.0:1790656413.258758:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790656413.258763:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943928721000 from 1 10000000:01000000:0.0:1790656413.258766:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790656413.258796:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.258803:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.258812:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656413.258832:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713920:0@lo:101: 00000100:00100000:0.0:1790656413.258889:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.258942:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000006067d87c going to sleep for 11 seconds 00000100:00100000:3.0:1790656413.259148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269713920 00000100:00100000:3.0:1790656413.259157:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269713920 00000100:00100000:3.0:1790656413.259204:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656413.259212:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afa0b1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5824:x1877639269713920:12345-0@lo:101: 00010000:00010000:3.0:1790656413.259224:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656413.259236:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055ab14d0/0x9c3a6e82066ea896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea88f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.259268:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055ab14d0/0x9c3a6e82066ea896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.259277:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055ab14d0/0x9c3a6e82066ea896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.259286:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055ab14d0, rc 0) 00000100:00100000:3.0:1790656413.259333:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afa0b1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269713920:12345-0@lo:101: Request processed in 122us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656413.259340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790656413.259691:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269713920:0@lo:101: 00010000:00010000:0.0:1790656413.259705:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.259714:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656413.259759:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714048:0@lo:501: 00000100:00100000:0.0:1790656413.259783:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.259824:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000006067d87c going to sleep for 11 seconds 00000100:00100000:3.0:1790656413.259893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714048 00000100:00100000:3.0:1790656413.259899:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714048 00000100:00100000:3.0:1790656413.259930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790656413.259937:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b48a51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714048:12345-0@lo:501: 00000100:00100000:3.0:1790656413.260247:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b48a51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714048:12345-0@lo:501: Request processed in 311us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656413.260255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790656413.261039:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714048:0@lo:501: 00000100:00100000:0.0:1790656413.262806:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714176:0@lo:503: 00000100:00100000:0.0:1790656413.262885:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.262935:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 000000006067d87c going to sleep for 11 seconds 00000100:00100000:3.0:1790656413.262943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714176 00000100:00100000:3.0:1790656413.262950:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714176 00000100:00100000:3.0:1790656413.262997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790656413.263005:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adbae67b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714176:12345-0@lo:503: 00000100:00100000:0.0:1790656413.264082:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714176:0@lo:503: 00000100:00100000:0.0:1790656413.264488:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5871:1877639269714304:0@lo:502: 00000100:00100000:0.0:1790656413.264533:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.264575:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fff6721 going to sleep for 11 seconds 00000100:00100000:2.0:1790656413.264578:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714304 00000100:00100000:2.0:1790656413.264585:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714304 00000100:00100000:2.0:1790656413.264675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790656413.264682:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d52db15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5871:x1877639269714304:12345-0@lo:502: 00000100:00100000:2.0:1790656413.264977:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d52db15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5871:x1877639269714304:12345-0@lo:502: Request processed in 295us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.264985:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656413.265009:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5871:1877639269714304:0@lo:502: 00000020:01000004:0.0:1790656413.265060:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790656413.265139:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009f24b494) 00000020:00000080:0.0:1790656413.265155:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790656413.265218:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c66d5f96 from lustre-MDT0000, refs=4 00000100:00100000:3.0:1790656413.265539:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adbae67b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714176:12345-0@lo:503: Request processed in 1052us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656413.265548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000004:0.0:1790656413.266172:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c66d5f96 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790656413.266175:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c66d5f96 4 00010000:00080000:0.0:1790656413.266209:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f1909ae4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1790656413.269346:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790656413.269580:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790656413.269645:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790656413.269657:0:5871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c3a6e82066ea8a4 00000100:00080000:2.0:1790656413.269666:0:5871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790656413.269675:0:5871:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f1909ae4 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656413.269708:0:5871:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f73985a0 x1877639269714432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656413.269736:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790656413.269908:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f73985a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269714432:0@lo:38: 00000100:00100000:1.0:1790656413.269972:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656413.270062:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714432 00000100:00100000:2.0:1790656413.270131:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714432 00000100:00100000:2.0:1790656413.270168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656413.270175:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008fa4bd7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1877639269714432:12345-0@lo:38: 00000100:00100000:2.0:1790656413.270273:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008fa4bd7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1877639269714432:12345-0@lo:38: Request processed in 97us (301us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790656413.270280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656413.272029:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5871:1877639269714560:0@lo:502: 00000100:00100000:3.0:1790656413.272102:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656413.272145:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4a78ec6 going to sleep for 11 seconds 00000100:00100000:0.0:1790656413.272150:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714560 00000100:00100000:0.0:1790656413.272156:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714560 00000100:00100000:0.0:1790656413.272202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790656413.272209:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080d4bf8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5871:x1877639269714560:12345-0@lo:502: 00000100:00100000:0.0:1790656413.273758:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080d4bf8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5871:x1877639269714560:12345-0@lo:502: Request processed in 1546us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656413.273769:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790656413.273798:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f0d8641 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:5871:1877639269714560:0@lo:502: 00000040:00080000:3.0:1790656413.273895:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1790656413.275173:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1790656413.275199:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790656413.275346:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656413.275364:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000f6280be3/0x9c3a6e82066ea88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790656413.275406:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790656413.275408:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790656413.275409:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656413.275410:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656413.275411:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656413.275412:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656413.275414:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790656413.275415:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790656413.275416:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656413.275418:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656413.275419:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656413.275420:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656413.275423:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1790656413.275426:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790656413.275427:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790656413.275428:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656413.275429:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656413.275430:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656413.275431:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656413.275432:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790656413.275433:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790656413.275433:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656413.275434:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656413.275435:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656413.275436:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656413.275456:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790656413.275470:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714688:0@lo:253: 00000100:00100000:0.0:1790656413.275521:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656413.275559:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf69e533 going to sleep for 11 seconds 00000100:00100000:0.0:1790656413.275578:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714688 00000100:00100000:0.0:1790656413.275583:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714688 00000100:00100000:0.0:1790656413.275642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790656413.275657:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012d05a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714688:12345-0@lo:253: 20000000:01000000:0.0:1790656413.275688:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790656413.275699:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790656413.276431:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790656413.276438:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000f1909ae4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790656413.276443:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790656413.276446:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f73985a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269714432:0@lo:38: 20000000:01000000:3.0:1790656413.368779:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790656413.368805:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790656413.368910:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790656413.368915:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790656413.368934:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.368951:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.368958:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.368992:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.369004:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 12 pid: 5836 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656413.369017:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269714816:0@lo:104: 00000100:00100000:1.0:1790656413.369074:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656413.369130:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fce36715 going to sleep for 11 seconds 00000100:00100000:3.0:1790656413.369261:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714816 00000100:00100000:3.0:1790656413.369269:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714816 00000100:00100000:3.0:1790656413.369313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656413.369321:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079613207 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269714816:12345-0@lo:104: 00010000:00010000:3.0:1790656413.369334:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.369393:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790656413.369398:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079613207 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269714816:12345-0@lo:104: Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656413.369405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656413.369660:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269714816:0@lo:104: 00010000:00010000:1.0:1790656413.369680:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.369917:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656413.369922:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.369931:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af1b3387 already unused, calling callback (0000000004fcd886) 10000000:00010000:1.0:1790656413.369934:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.369942:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656413.369948:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656413.369953:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790656413.369990:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.369996:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656413.370012:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.370018:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea87a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.370033:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656413.370035:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656413.370037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656413.370123:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269714944:0@lo:103: 00000100:00100000:1.0:1790656413.370164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656413.371826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269714944 00000100:00100000:3.0:1790656413.371839:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269714944 00010000:00010000:3.0:1790656413.371872:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 13 pid: 5836 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656413.371910:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656413.371917:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f308348 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3300:x1877639269714944:12345-0@lo:103: 00010000:00010000:3.0:1790656413.371930:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656413.371934:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 13 pid: 5836 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.371945:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 13 pid: 5836 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.371976:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ceb0382b/0x9c3a6e82066ea87a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea873 expref: 13 pid: 5836 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.371992:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.371999:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790656413.372012:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003098230s 00010000:00010000:3.0:1790656413.372015:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.372022:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.372028:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.372034:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.372039:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009593c593 already unused, calling callback (00000000f8490746) 00010000:00010000:3.0:1790656413.372042:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.372049:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.377267:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656413.377288:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656413.384151:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012d05a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5824:x1877639269714688:12345-0@lo:253: Request processed in 108489us (108624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656413.384166:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790656413.384260:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:5824:1877639269714688:0@lo:253: 10000000:01000000:0.0:1790656413.384275:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790656413.384278:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790656413.384280:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790656413.384281:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656413.384283:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656413.384284:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656413.384285:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656413.384286:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790656413.384287:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790656413.384289:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656413.384290:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656413.384292:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656413.384295:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790656413.384313:0:5824:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1790656413.385766:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.385803:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009593c593/0x9c3a6e82066ea8ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656413.386734:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656413.389171:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f308348 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3300:x1877639269714944:12345-0@lo:103: Request processed in 17246us (18999us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656413.389186:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656413.395778:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269714944:0@lo:103: 00080000:10000000:0.0:1790656413.399403:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.399795:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790656413.400053:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.400233:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790656413.400460:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790656413.404312:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790656413.406444:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656413.406900:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790656413.407098:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656413.407269:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790656413.407457:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656413.407673:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1790656413.410142:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1790656413.474122:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790656413.502904:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790656413.502984:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790656413.502988:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790656413.503586:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790656413.506698:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790656413.506965:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790656413.507397:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790656413.507404:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790656413.507534:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656413.508999:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790656413.509645:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790656413.509672:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790656413.509994:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790656413.510155:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1790656413.512622:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790656413.514554:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790656413.514703:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790656413.514946:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790656413.515065:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1790656413.515190:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790656413.515303:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790656413.515447:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790656413.515559:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790656413.515733:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790656413.517146:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790656413.517353:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790656413.517493:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790656413.519751:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790656413.519988:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790656413.520141:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790656413.520424:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790656413.520626:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790656413.521874:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790656413.522015:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790656413.522150:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790656413.522292:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790656413.522436:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790656413.522583:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790656413.522758:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790656413.522891:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790656413.523008:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790656413.523154:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790656413.523293:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790656413.523443:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790656413.523626:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790656413.523795:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790656413.523990:0:5824:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790656413.555003:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1790656413.597702:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790656413.597740:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba9341913988 00100000:10000000:2.0:1790656413.597748:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790656413.598401:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790656413.598416:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790656413.598427:0:5824:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790656413.598441:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790656413.648326:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790656413.648399:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790656413.648405:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790656414.430740:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656415.454992:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656416.479765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656417.511833:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790656418.081315:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1790656418.463844:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790656418.463854:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790656418.463857:0:38:0:(import.c:65:import_set_state_nolock()) 00000000f1909ae4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790656418.463874:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f1909ae4 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656418.463895:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000952d482 x1877639269715200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790656418.463980:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656418.463994:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269715072:0@lo:400: 00000100:00100000:1.0:1790656418.464055:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656418.464125:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000952d482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269715200:0@lo:38: 00000100:00100000:1.0:1790656418.464150:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656418.464398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715072 00000100:00100000:2.0:1790656418.464406:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715072 00000100:00100000:2.0:1790656418.464458:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790656418.464467:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f42e1c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3302:x1877639269715072:12345-0@lo:400: 00000100:00100000:2.0:1790656418.464539:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f42e1c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3302:x1877639269715072:12345-0@lo:400: Request processed in 73us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656418.464547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790656418.464583:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715200 00000100:00100000:2.0:1790656418.464619:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715200 00000100:00100000:2.0:1790656418.464643:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656418.464647:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6baec00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269715200:12345-0@lo:38: 00010000:00080000:2.0:1790656418.464667:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:2.0:1790656418.464780:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c3a6e82066ea8b2 00000004:00100000:2.0:1790656418.464821:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790656418.465404:0:5845:0:(import.c:65:import_set_state_nolock()) 00000000cb54e4c3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656418.465622:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269715072:0@lo:400: 00000100:00100000:2.0:1790656418.466438:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6baec00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1877639269715200:12345-0@lo:38: Request processed in 1788us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656418.466459:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790656418.467628:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000952d482 x1877639269715200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790656418.467770:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790656418.467781:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790656418.467786:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790656418.467789:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000f1909ae4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790656418.467796:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000952d482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269715200:0@lo:38: 00010000:00010000:1.0:1790656418.526888:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656419.554501:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790656419.998882:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790656419.999065:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943928721000 from 3 10000000:01000000:2.0:1790656419.999069:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790656419.999115:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656419.999128:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656419.999139:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656419.999162:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f77bc3d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715328:0@lo:101: 00000100:00100000:2.0:1790656419.999229:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656419.999352:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a642e2f4 going to sleep for 11 seconds 00000100:00100000:3.0:1790656419.999795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715328 00000100:00100000:3.0:1790656419.999803:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715328 00000100:00100000:3.0:1790656419.999905:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790656419.999914:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081ffb46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5840:x1877639269715328:12345-0@lo:101: 00010000:00010000:3.0:1790656419.999928:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656419.999940:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c594363/0x9c3a6e82066ea8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea8b9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656420.000170:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c594363/0x9c3a6e82066ea8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656420.000182:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c594363/0x9c3a6e82066ea8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656420.000191:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c594363, rc 0) 00000100:00100000:3.0:1790656420.000253:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081ffb46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269715328:12345-0@lo:101: Request processed in 341us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656420.000259:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790656420.000342:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f77bc3d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715328:0@lo:101: 00010000:00010000:0.0:1790656420.000358:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656420.000376:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656420.000451:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715456:0@lo:256: 00000100:00100000:0.0:1790656420.000487:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656420.000920:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c3ebf09 going to sleep for 10 seconds 00000100:00100000:2.0:1790656420.005170:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715456 00000100:00100000:2.0:1790656420.005185:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715456 00000100:00100000:2.0:1790656420.005237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790656420.005244:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0a9066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269715456:12345-0@lo:256: 20000000:01000000:2.0:1790656420.005267:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790656420.005289:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790656420.005291:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790656420.005398:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0a9066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269715456:12345-0@lo:256: Request processed in 154us (4910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656420.005405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790656420.005731:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715456:0@lo:256: 10000000:01000000:0.0:1790656420.005779:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790656420.005787:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656420.005797:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000a905bdd0/0x9c3a6e82066ea8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656420.577448:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656421.601058:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656422.623163:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790656422.902761:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2b80aa30 20000000:00000080:2.0:1790656422.902778:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9439121a0800 uarg=0000000000000000 20000000:01000000:2.0:1790656422.903035:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790656422.903048:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790656422.903054:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790656422.903235:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790656422.903246:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790656422.910901:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656422.911168:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790656422.911227:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790656422.911281:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790656422.911299:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790656422.911316:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656422.911332:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656422.911339:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656422.911388:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656422.911403:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 11 pid: 5837 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656422.911417:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1bd69aa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1877639269715584:0@lo:104: 00000100:00100000:2.0:1790656422.911479:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656422.911533:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb927a8c going to sleep for 11 seconds 00000100:00100000:1.0:1790656422.912033:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715584 00000100:00100000:1.0:1790656422.912041:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715584 00000100:00100000:1.0:1790656422.912100:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790656422.912109:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c69b66a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:6321:x1877639269715584:12345-0@lo:104: 00010000:00010000:1.0:1790656422.912121:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912240:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790656422.912246:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c69b66a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:6321:x1877639269715584:12345-0@lo:104: Request processed in 139us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656422.912253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790656422.912272:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656422.912276:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912284:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023cb8686 already unused, calling callback (0000000004fcd886) 10000000:00010000:1.0:1790656422.912287:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912293:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656422.912311:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656422.912316:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790656422.912341:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912346:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656422.912364:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912370:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000023cb8686/0x9c3a6e82066ea881 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea888 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.912398:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656422.912400:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656422.912401:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656422.912412:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269715712:0@lo:103: 00000100:00100000:1.0:1790656422.912442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656422.912934:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1bd69aa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1877639269715584:0@lo:104: 00010000:00010000:2.0:1790656422.912953:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656422.913145:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715712 00000100:00100000:0.0:1790656422.913152:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715712 00010000:00010000:0.0:1790656422.913172:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 12 pid: 5837 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656422.913205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656422.913212:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007f1802b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3302:x1877639269715712:12345-0@lo:103: 00010000:00010000:0.0:1790656422.913223:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656422.913227:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 12 pid: 5837 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913237:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 12 pid: 5837 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913251:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f8173dc/0x9c3a6e82066ea888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea881 expref: 12 pid: 5837 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913275:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913283:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913296:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913302:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913308:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913314:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913319:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000039efc542 already unused, calling callback (00000000f8490746) 00010000:00010000:0.0:1790656422.913322:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913329:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913350:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656422.913359:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656422.913461:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.913469:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656422.913474:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039efc542/0x9c3a6e82066ea8c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656422.914950:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007f1802b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3302:x1877639269715712:12345-0@lo:103: Request processed in 1735us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656422.914974:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656422.915033:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035e18e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269715712:0@lo:103: 00000100:00100000:3.0:1790656423.582931:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656423.582957:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269715840:0@lo:400: 00000100:00100000:3.0:1790656423.583080:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656423.583301:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715840 00000100:00100000:2.0:1790656423.583382:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715840 00000100:00100000:2.0:1790656423.583436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656423.583443:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f0d8641 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269715840:12345-0@lo:400: 00000100:00100000:2.0:1790656423.583502:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f0d8641 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269715840:12345-0@lo:400: Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656423.583509:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790656423.583647:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f3ac4598 x1877639269715840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656423.583660:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3ac4598 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269715840:0@lo:400: 00010000:00010000:0.0:1790656423.650888:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656424.670692:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656425.697636:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656426.718917:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656427.742940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790656428.195787:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790656428.195795:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943928721000 from 1 10000000:01000000:1.0:1790656428.195799:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790656428.196119:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea8ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656428.196132:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea8ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656428.196142:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea8ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656428.196164:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715968:0@lo:101: 00000100:00100000:1.0:1790656428.196225:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656428.196273:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037b4c420 going to sleep for 11 seconds 00000100:00100000:3.0:1790656428.196545:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269715968 00000100:00100000:3.0:1790656428.196554:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269715968 00000100:00100000:3.0:1790656428.196619:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790656428.196628:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004b195c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:5840:x1877639269715968:12345-0@lo:101: 00010000:00010000:3.0:1790656428.196640:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656428.196663:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7742575/0x9c3a6e82066ea8d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea8ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656428.196684:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7742575/0x9c3a6e82066ea8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656428.196739:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7742575/0x9c3a6e82066ea8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656428.196748:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7742575, rc 0) 00000100:00100000:3.0:1790656428.196786:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004b195c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269715968:12345-0@lo:101: Request processed in 160us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.196792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656428.198211:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269715968:0@lo:101: 00010000:00010000:1.0:1790656428.198232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea8ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656428.198242:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000af1b3387/0x9c3a6e82066ea8ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656428.198306:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269716096:0@lo:501: 00000100:00100000:1.0:1790656428.198346:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656428.198397:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037b4c420 going to sleep for 11 seconds 00000100:00100000:3.0:1790656428.200965:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716096 00000100:00100000:3.0:1790656428.200978:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716096 00000100:00100000:3.0:1790656428.201026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656428.201034:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008853a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269716096:12345-0@lo:501: 00000100:00100000:3.0:1790656428.201297:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008853a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269716096:12345-0@lo:501: Request processed in 264us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.201304:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790656428.201439:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269716096:0@lo:501: 00000100:00100000:1.0:1790656428.201484:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269716224:0@lo:503: 00000100:00100000:1.0:1790656428.201540:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656428.201584:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037b4c420 going to sleep for 11 seconds 00000100:00100000:3.0:1790656428.202815:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716224 00000100:00100000:3.0:1790656428.202826:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716224 00000100:00100000:3.0:1790656428.202936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656428.202943:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078a7a0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269716224:12345-0@lo:503: 00000100:00100000:3.0:1790656428.203146:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078a7a0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269716224:12345-0@lo:503: Request processed in 202us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.203153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790656428.203279:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269716224:0@lo:503: 00000100:00100000:1.0:1790656428.207157:0:6653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6653:1877639269716352:0@lo:502: 00000100:00100000:1.0:1790656428.207242:0:6653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656428.207286:0:6653:0:(client.c:2716:ptlrpc_set_wait()) set 000000002348a265 going to sleep for 11 seconds 00000100:00100000:3.0:1790656428.207469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716352 00000100:00100000:3.0:1790656428.207478:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716352 00000100:00100000:3.0:1790656428.207523:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790656428.207541:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2d94d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6653:x1877639269716352:12345-0@lo:502: 00000100:00100000:3.0:1790656428.209110:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2d94d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6653:x1877639269716352:12345-0@lo:502: Request processed in 1565us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.209122:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790656428.210159:0:6653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c956926f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6653:1877639269716352:0@lo:502: 00000020:01000000:1.0:1790656428.210198:0:6653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656428.210207:0:6653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656428.210209:0:6653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790656428.210216:0:6653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943928721000 00000020:00000080:1.0:1790656428.210219:0:6653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790656428.210265:0:6653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6653:1877639269716480:0@lo:502: 00000100:00100000:1.0:1790656428.210310:0:6653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656428.210345:0:6653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6840 going to sleep for 11 seconds 00000100:00100000:3.0:1790656428.210411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716480 00000100:00100000:3.0:1790656428.210417:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716480 00000100:00100000:3.0:1790656428.210455:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790656428.210462:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6653:x1877639269716480:12345-0@lo:502: 00000100:00100000:3.0:1790656428.210671:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6653:x1877639269716480:12345-0@lo:502: Request processed in 208us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.210678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790656428.210928:0:6653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6653:1877639269716480:0@lo:502: 00000020:01000000:0.0:1790656428.210947:0:6653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656428.210951:0:6653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656428.210953:0:6653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790656428.210957:0:6653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790656428.211017:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790656428.211032:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790656428.211041:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656428.211052:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656428.702781:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656428.703057:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269716608:0@lo:400: 00000100:00100000:2.0:1790656428.703122:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656428.707807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716608 00000100:00100000:3.0:1790656428.707822:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716608 00000100:00100000:3.0:1790656428.707952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790656428.707961:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269716608:12345-0@lo:400: 00000100:00100000:3.0:1790656428.708100:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269716608:12345-0@lo:400: Request processed in 139us (4976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656428.708122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790656428.716924:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393bf98700 x1877639269716608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656428.716942:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269716608:0@lo:400: 00010000:00010000:3.0:1790656428.768229:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790656429.149356:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790656429.149359:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790656429.151938:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94392d856000 00000020:01000004:0.0:1790656429.151959:0:6686:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790656429.151971:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790656429.151994:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94393c9c19c0) 00000020:00000080:0.0:1790656429.152014:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790656429.182239:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790656429.184036:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790656429.220480:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790656429.226010:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790656429.226049:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790656429.226110:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790656429.226137:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790656429.226466:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790656429.226476:0:6686:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790656429.226485:0:6686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c3a6e82066ea8e3 00000020:01000004:3.0:1790656429.226493:0:6686:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790656429.226515:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790656429.226529:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790656429.226536:0:6686:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790656429.226540:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790656429.226551:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94392810cd40) 00000020:00000080:3.0:1790656429.226562:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1790656429.230139:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656429.231881:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790656429.231892:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790656429.238816:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790656429.238837:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790656429.240015:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790656429.240024:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790656429.245858:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656429.246035:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790656429.246041:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790656429.248043:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790656429.248052:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790656429.267549:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656429.267909:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790656429.267915:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790656429.271290:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790656429.271305:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790656429.272362:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790656429.272378:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790656429.276118:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656429.276331:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790656429.276338:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790656429.277135:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790656429.277143:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790656429.322770:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656429.323131:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790656429.323138:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790656429.326397:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790656429.326410:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790656429.327056:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790656429.327078:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790656429.327083:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790656429.355201:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790656429.355234:0:6686:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790656429.355239:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790656429.355240:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790656429.355242:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656429.355243:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656429.355245:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656429.355246:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656429.355248:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790656429.355249:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790656429.355250:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790656429.355252:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656429.355253:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656429.355257:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790656429.355259:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790656429.355260:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790656429.355265:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656429.355266:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656429.355267:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656429.355268:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656429.355269:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790656429.355270:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790656429.355271:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790656429.355272:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656429.355273:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656429.355297:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790656429.355313:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269716736:0@lo:253: 00000100:00100000:2.0:1790656429.355390:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.355486:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928002e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656429.355824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716736 00000100:00100000:3.0:1790656429.355833:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716736 00000100:00100000:3.0:1790656429.355992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790656429.356004:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269716736:12345-0@lo:253: 20000000:01000000:3.0:1790656429.356042:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790656429.356046:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790656429.356050:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790656429.356053:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790656429.356963:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656429.357151:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790656429.357163:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790656429.357194:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790656429.357200:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790656429.357223:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790656429.357261:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790656429.357631:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790656429.357649:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1790656429.357651:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1790656429.357685:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790656429.357694:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790656429.357937:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790656429.357951:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1790656429.357982:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790656429.357990:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790656429.358013:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790656429.358052:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790656429.359104:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790656429.359125:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:2.0:1790656429.359127:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:2.0:1790656429.359155:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790656429.359161:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790656429.359184:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790656429.359190:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:2.0:1790656429.359237:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790656429.359245:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790656429.359278:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1790656429.359312:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1790656429.359328:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790656429.359330:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790656429.359334:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790656429.359347:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790656429.359349:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790656429.359379:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790656429.359381:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790656429.360451:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790656429.360795:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790656429.360841:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790656429.361146:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790656429.361180:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790656429.361242:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790656429.361256:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790656429.361258:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790656429.361813:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1790656429.361853:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1790656429.361973:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790656429.362180:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1790656429.362212:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1790656429.362240:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1790656429.362250:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790656429.362252:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790656429.364378:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790656429.367935:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1790656429.367987:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1790656429.368088:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1790656429.368117:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1790656429.368119:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1790656429.368129:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790656429.368151:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368167:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368175:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368182:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368188:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368224:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368240:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.368254:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269716864:0@lo:104: 00000100:00100000:2.0:1790656429.368317:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790656429.368415:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.368423:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 12 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.368441:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269716992:0@lo:104: 00000100:00100000:2.0:1790656429.368462:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790656429.373352:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.373371:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 12 pid: 5837 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.373384:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269717120:0@lo:104: 00000100:00100000:2.0:1790656429.373456:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.373879:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716864 00000100:00100000:0.0:1790656429.373887:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716864 00000100:00100000:0.0:1790656429.373930:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269716992 00000100:00100000:0.0:1790656429.373934:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269716992 00000100:00100000:0.0:1790656429.373947:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790656429.373956:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:5838:x1877639269716864:12345-0@lo:104: 00010000:00010000:0.0:1790656429.373969:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.374038:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656429.374044:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:5838:x1877639269716864:12345-0@lo:104: Request processed in 89us (5728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.374051:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790656429.374068:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656429.374074:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269716992:12345-0@lo:104: 00010000:00010000:0.0:1790656429.374082:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.374113:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790656429.374118:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269716992:12345-0@lo:104: Request processed in 45us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.374134:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790656429.374187:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790656429.374194:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374202:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031a00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656429.374206:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374214:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656429.374221:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656429.374226:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790656429.374259:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374276:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656429.374296:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374303:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031a00/0x9c3a6e82066ea88f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea896 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374321:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656429.374324:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374330:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ff600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656429.374333:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374339:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656429.374346:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656429.374351:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790656429.374364:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374370:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656429.374374:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374382:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea826 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.374399:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.374401:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.374408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656429.374420:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269717248:0@lo:103: 00000100:00100000:3.0:1790656429.374452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.374487:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656429.374493:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269717376:0@lo:103: 00000100:00100000:3.0:1790656429.374512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.374553:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717248 00000100:00100000:3.0:1790656429.374558:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717248 00010000:00010000:3.0:1790656429.374578:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 13 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656429.374624:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717376 00000100:00100000:3.0:1790656429.374628:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717376 00010000:00010000:3.0:1790656429.374640:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656429.374652:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656429.374658:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3301:x1877639269717248:12345-0@lo:103: 00010000:00010000:3.0:1790656429.374668:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656429.374673:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374683:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374721:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656429.374750:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3301:x1877639269717248:12345-0@lo:103: Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.374757:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656429.374772:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656429.374779:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3301:x1877639269717376:12345-0@lo:103: 00010000:00010000:3.0:1790656429.374786:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656429.374790:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 13 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374799:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 13 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.374807:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656429.374828:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3301:x1877639269717376:12345-0@lo:103: Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.374834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656429.374870:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269717376:0@lo:103: 00000100:00100000:3.0:1790656429.374877:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269717248:0@lo:103: 00000100:00100000:2.0:1790656429.375217:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00010000:00010000:2.0:1790656429.375231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c200/0x9c3a6e82066ea896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea88f expref: 12 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.375245:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269716864:0@lo:104: 00010000:00010000:2.0:1790656429.375254:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900031000/0x9c3a6e82066ea826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea81f expref: 11 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.375264:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269716992:0@lo:104: 00000100:00100000:0.0:1790656429.375308:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717120 00000100:00100000:0.0:1790656429.375313:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717120 00000100:00100000:0.0:1790656429.375334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656429.375340:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269717120:12345-0@lo:104: 00010000:00010000:0.0:1790656429.375349:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.375405:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656429.375411:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269717120:12345-0@lo:104: Request processed in 71us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.375416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790656429.375463:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656429.375468:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.375475:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656429.375479:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.375496:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656429.375503:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656429.375508:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790656429.375543:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.375550:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656429.375568:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.375575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900030200/0x9c3a6e82066ea803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea80a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.375632:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.375634:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.375636:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656429.375647:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269717504:0@lo:103: 00000100:00100000:3.0:1790656429.375677:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.375724:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717504 00000100:00100000:3.0:1790656429.375729:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717504 00010000:00010000:3.0:1790656429.375744:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 11 pid: 5837 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656429.375762:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656429.375768:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3299:x1877639269717504:12345-0@lo:103: 00010000:00010000:3.0:1790656429.377774:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656429.377785:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 11 pid: 5837 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.377800:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 11 pid: 5837 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.377821:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.377830:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.377848:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.378014:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea80a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea803 expref: 11 pid: 5837 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.378029:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269717120:0@lo:104: 00010000:00010000:2.0:1790656429.378058:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.378067:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.378096:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790656429.378103:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1790656429.379022:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379033:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379040:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379046:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013fe200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656429.379050:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379059:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379083:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379090:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013fe200/0x9c3a6e82066ea8f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.379106:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656429.380556:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:3299:x1877639269717504:12345-0@lo:103: Request processed in 4778us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.380569:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656429.383105:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269717504:0@lo:103: 00000100:00100000:0.0:1790656429.458029:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:6686:x1877639269716736:12345-0@lo:253: Request processed in 102020us (102630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.458044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790656429.463763:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269716736:0@lo:253: 10000000:01000000:2.0:1790656429.463785:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790656429.463789:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790656429.463790:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790656429.463792:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656429.463793:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790656429.463795:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656429.463796:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656429.463797:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790656429.463799:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790656429.463800:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656429.463802:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790656429.463825:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94392d856000 from lustre-OST0000 10000000:01000000:2.0:1790656429.463852:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790656429.463855:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790656429.463861:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94390a368000 local copy 10000000:01000000:2.0:1790656429.463865:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790656429.463901:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.463912:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.463922:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.463939:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717632:0@lo:101: 00000100:00100000:2.0:1790656429.464011:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.464124:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.465877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717632 00000100:00100000:1.0:1790656429.465889:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717632 00000100:00100000:1.0:1790656429.466001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790656429.466011:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:6686:x1877639269717632:12345-0@lo:101: 00010000:00010000:1.0:1790656429.466027:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656429.466047:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ea8ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea8f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.466072:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ea8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8f8 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.466085:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ea8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8f8 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.466111:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf200, rc 0) 00000100:00100000:1.0:1790656429.466184:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:6686:x1877639269717632:12345-0@lo:101: Request processed in 175us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.466191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790656429.466280:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717632:0@lo:101: 00010000:00010000:2.0:1790656429.466297:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.466307:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.466417:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717760:0@lo:501: 00000100:00100000:2.0:1790656429.466448:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.470768:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656429.470904:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717760 00000100:00100000:0.0:1790656429.470915:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717760 00000100:00100000:0.0:1790656429.470966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790656429.470976:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:6686:x1877639269717760:12345-0@lo:501: 00000100:00100000:0.0:1790656429.471257:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:6686:x1877639269717760:12345-0@lo:501: Request processed in 282us (4807us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790656429.471265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790656429.471376:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717760:0@lo:501: 10000000:01000000:2.0:1790656429.471394:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790656429.471423:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790656429.471431:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.471442:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.471449:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.471795:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790656429.471820:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94392d856000 10000000:01000000:2.0:1790656429.471826:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790656429.471831:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94390a368000 10000000:01000000:2.0:1790656429.471841:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790656429.471844:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94390a368000 from 1 10000000:01000000:2.0:1790656429.471847:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790656429.471877:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.471886:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.471895:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.471912:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717888:0@lo:101: 00000100:00100000:2.0:1790656429.471948:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.471964:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54600 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.472037:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269717888 00000100:00100000:1.0:1790656429.472043:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269717888 00000100:00100000:1.0:1790656429.472073:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790656429.472079:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+10:6686:x1877639269717888:12345-0@lo:101: 00010000:00010000:1.0:1790656429.472089:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656429.472100:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cee00/0x9c3a6e82066ea90d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea906 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.472122:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cee00/0x9c3a6e82066ea90d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea906 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.472131:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cee00/0x9c3a6e82066ea90d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea906 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.472139:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cee00, rc 0) 00000100:00100000:1.0:1790656429.472168:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269717888:12345-0@lo:101: Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.472174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790656429.472256:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269717888:0@lo:101: 00010000:00010000:2.0:1790656429.472269:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.472276:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656429.472291:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790656429.472308:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.472315:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656429.472320:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790656429.472329:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656429.472334:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790656429.472335:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790656429.472350:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.472357:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.472365:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.472376:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718016:0@lo:101: 00000100:00100000:2.0:1790656429.472402:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.472422:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54600 going to sleep for 11 seconds 00010000:00010000:0.0:1790656429.472622:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656429.472628:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472657:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013fea00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656429.472661:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472668:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656429.472674:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656429.472680:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656429.472792:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472799:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656429.472825:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472832:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013fea00/0x9c3a6e82066ea8f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea8ff expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472844:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656429.472846:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656429.472847:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656429.472858:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718016 00000100:00100000:0.0:1790656429.472861:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718016 00000100:00100000:0.0:1790656429.472881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790656429.472886:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718016:12345-0@lo:101: 00010000:00010000:0.0:1790656429.472893:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656429.472906:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea914 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472919:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472927:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.472933:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030a00, rc 0) 00000100:00100000:0.0:1790656429.472967:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718016:12345-0@lo:101: Request processed in 81us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.472973:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790656429.472994:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656429.473003:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269718144:0@lo:103: 00000100:00100000:0.0:1790656429.473025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.473102:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718016:0@lo:101: 00010000:00010000:2.0:1790656429.473112:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.473119:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.473191:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718272:0@lo:501: 00000100:00100000:2.0:1790656429.473213:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.473230:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54600 going to sleep for 11 seconds 00000100:00100000:0.0:1790656429.473273:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718272 00000100:00100000:0.0:1790656429.473278:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718272 00000100:00100000:0.0:1790656429.473295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790656429.473301:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718272:12345-0@lo:501: 00000100:00100000:0.0:1790656429.473903:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718272:12345-0@lo:501: Request processed in 600us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.473910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790656429.473987:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718144 00000100:00100000:3.0:1790656429.473992:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718144 00000100:00100000:3.0:1790656429.474031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656429.474038:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3299:x1877639269718144:12345-0@lo:103: 00010000:00010000:3.0:1790656429.474048:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656429.474063:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ea8ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066ea8f8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.474074:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656429.474107:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:3299:x1877639269718144:12345-0@lo:103: Request processed in 69us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.474112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656429.474141:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269718144:0@lo:103: 00000100:00100000:1.0:1790656429.474226:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718272:0@lo:501: 00000100:00100000:1.0:1790656429.474258:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718400:0@lo:503: 00000100:00100000:1.0:1790656429.474302:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656429.474332:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b71180 going to sleep for 11 seconds 00000100:00100000:0.0:1790656429.474384:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718400 00000100:00100000:0.0:1790656429.474388:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718400 00000100:00100000:0.0:1790656429.474417:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790656429.474423:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718400:12345-0@lo:503: 00000100:00100000:0.0:1790656429.474744:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718400:12345-0@lo:503: Request processed in 320us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.474758:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790656429.474924:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718400:0@lo:503: 00000040:00080000:3.0:1790656429.475190:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790656429.475256:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718528:0@lo:502: 00000100:00100000:3.0:1790656429.475294:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.475335:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439121f8480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656429.475383:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718528 00000100:00100000:0.0:1790656429.475387:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718528 00000100:00100000:0.0:1790656429.475420:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790656429.475427:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718528:12345-0@lo:502: 00000100:00100000:0.0:1790656429.475989:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718528:12345-0@lo:502: Request processed in 561us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.475996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790656429.476064:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718528:0@lo:502: 00000040:00080000:3.0:1790656429.476308:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790656429.476355:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790656429.476392:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790656429.476440:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790656429.476632:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790656429.476672:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790656429.476759:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718656:0@lo:502: 00000100:00100000:3.0:1790656429.476804:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.476889:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439121f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.477020:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718656 00000100:00100000:1.0:1790656429.477027:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718656 00000100:00100000:1.0:1790656429.477092:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790656429.477100:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718656:12345-0@lo:502: 00000100:00100000:1.0:1790656429.477256:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718656:12345-0@lo:502: Request processed in 157us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.477263:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790656429.477329:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718656:0@lo:502: 00000040:00080000:3.0:1790656429.477433:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790656429.477444:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1790656429.478357:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790656429.478365:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790656429.478372:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656429.478375:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790656429.478382:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790656429.478395:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff943928108000) 00000020:00000080:3.0:1790656429.478414:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790656429.478419:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790656429.478509:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94392d856000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790656429.478525:0:6706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790656429.478533:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c3a6e82066ea929 00010000:00010000:3.0:1790656429.483802:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790656429.484122:0:6706:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790656429.493665:0:6706:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790656429.494734:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790656429.520095:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790656429.523003:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790656429.525224:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790656429.525234:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656429.526825:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656429.526830:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790656429.526839:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656429.526844:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656429.526846:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790656429.526850:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790656429.526852:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790656429.526907:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656429.526911:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656429.526913:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790656429.526916:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790656429.527344:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1790656429.527368:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790656429.527388:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.527403:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656429.527410:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94392d856000 from 1 10000000:01000000:0.0:1790656429.527414:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790656429.527450:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.527459:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.527480:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656429.527527:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718784:0@lo:101: 00000100:00100000:0.0:1790656429.527613:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.527666:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656429.528353:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718784 00000100:00100000:2.0:1790656429.528362:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718784 00000100:00100000:2.0:1790656429.528799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790656429.528810:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:6686:x1877639269718784:12345-0@lo:101: 00010000:00010000:2.0:1790656429.528825:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656429.528840:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea930 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.528864:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.528876:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.528885:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013fe800, rc 0) 00000100:00100000:2.0:1790656429.528933:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718784:12345-0@lo:101: Request processed in 126us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656429.528940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790656429.529846:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718784:0@lo:101: 00010000:00010000:0.0:1790656429.529866:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.529877:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656429.530641:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718912:0@lo:501: 00000100:00100000:0.0:1790656429.530766:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.543282:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.544286:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269718912 00000100:00100000:1.0:1790656429.544297:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269718912 00000100:00100000:1.0:1790656429.544339:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790656429.544348:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718912:12345-0@lo:501: 00000100:00100000:1.0:1790656429.544671:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269718912:12345-0@lo:501: Request processed in 323us (13975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.544679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790656429.545089:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269718912:0@lo:501: 00000100:00100000:0.0:1790656429.545133:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719040:0@lo:503: 00000100:00100000:0.0:1790656429.545176:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.545203:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.545261:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719040 00000100:00100000:1.0:1790656429.545266:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719040 00000100:00100000:1.0:1790656429.545287:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790656429.545294:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719040:12345-0@lo:503: 00000100:00100000:1.0:1790656429.545575:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719040:12345-0@lo:503: Request processed in 280us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.545582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790656429.545736:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719040:0@lo:503: 00000040:00080000:0.0:1790656429.546025:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790656429.546089:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719168:0@lo:502: 00000100:00100000:0.0:1790656429.546127:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.546152:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.546434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719168 00000100:00100000:1.0:1790656429.546440:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719168 00000100:00100000:1.0:1790656429.546462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656429.546485:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719168:12345-0@lo:502: 00000100:00100000:1.0:1790656429.546683:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719168:12345-0@lo:502: Request processed in 214us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.546877:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719168:0@lo:502: 00000040:00080000:0.0:1790656429.547104:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790656429.547153:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790656429.547177:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719296:0@lo:502: 00000100:00100000:0.0:1790656429.547214:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.547238:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.547358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656429.547388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719296 00000100:00100000:1.0:1790656429.547392:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719296 00000100:00100000:1.0:1790656429.547410:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656429.547416:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719296:12345-0@lo:502: 00000100:00100000:1.0:1790656429.547566:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719296:12345-0@lo:502: Request processed in 149us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.547573:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790656429.547823:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719296:0@lo:502: 00000040:00080000:0.0:1790656429.547907:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790656429.547917:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790656429.548454:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656429.548462:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656429.548465:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790656429.548485:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94392d856000 00000020:00000080:0.0:1790656429.548487:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790656429.548506:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656429.548509:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656429.548510:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790656429.548513:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790656429.548839:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790656429.548862:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790656429.548878:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.548889:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656429.548926:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790656429.548929:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94392d856000 10000000:01000000:1.0:1790656429.548932:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94392d856000 10000000:01000000:1.0:1790656429.548935:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790656429.548941:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94392d856000 from 1 10000000:01000000:1.0:1790656429.548944:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790656429.548973:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.548981:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.548991:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656429.549017:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719424:0@lo:101: 00000100:00100000:1.0:1790656429.549064:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656429.549099:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b71540 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.549123:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719424 00000100:00100000:1.0:1790656429.549129:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719424 00000100:00100000:1.0:1790656429.549159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790656429.549167:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269719424:12345-0@lo:101: 00010000:00010000:1.0:1790656429.549177:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656429.549189:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea93e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.549211:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.549221:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.549229:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce200, rc 0) 00000100:00100000:1.0:1790656429.549833:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719424:12345-0@lo:101: Request processed in 666us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.549841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790656429.549978:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719424:0@lo:101: 00010000:00010000:0.0:1790656429.549992:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656429.550000:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656429.550077:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719552:0@lo:501: 00000100:00100000:0.0:1790656429.550103:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.550171:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656429.550203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719552 00000100:00100000:2.0:1790656429.550209:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719552 00000100:00100000:2.0:1790656429.550352:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790656429.550360:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719552:12345-0@lo:501: 00000100:00100000:3.0:1790656429.551083:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719552:12345-0@lo:501: Request processed in 721us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.551091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790656429.551156:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719552:0@lo:501: 00000100:00100000:0.0:1790656429.551190:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719680:0@lo:503: 00000100:00100000:0.0:1790656429.551237:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.551358:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656429.551391:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719680 00000100:00100000:3.0:1790656429.551397:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719680 00000100:00100000:3.0:1790656429.551693:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790656429.551769:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719680:12345-0@lo:503: 00000100:00100000:3.0:1790656429.551961:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719680:12345-0@lo:503: Request processed in 195us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.551968:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790656429.552061:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719680:0@lo:503: 00000040:00080000:0.0:1790656429.552383:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790656429.552444:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719808:0@lo:502: 00000100:00100000:0.0:1790656429.552768:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.552854:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656429.552911:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719808 00000100:00100000:3.0:1790656429.552918:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719808 00000100:00100000:3.0:1790656429.552955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790656429.552963:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719808:12345-0@lo:502: 00000100:00100000:3.0:1790656429.553156:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719808:12345-0@lo:502: Request processed in 194us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.553163:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790656429.553327:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719808:0@lo:502: 00000040:00080000:2.0:1790656429.553655:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790656429.553818:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790656429.553856:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790656429.553911:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790656429.553950:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790656429.553995:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790656429.554031:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790656429.554065:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790656429.554111:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790656429.554148:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790656429.554180:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790656429.554222:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790656429.554897:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790656429.554947:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790656429.555021:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790656429.555062:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790656429.555098:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790656429.555143:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790656429.555174:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790656429.555203:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790656429.555259:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790656429.555295:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790656429.555331:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790656429.555395:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790656429.555436:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790656429.555474:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790656429.555546:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790656429.555617:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1790656429.555669:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719936:0@lo:502: 00000100:00100000:3.0:1790656429.555738:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.555784:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff943911c5c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656429.556878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269719936 00000100:00100000:2.0:1790656429.556888:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269719936 00000100:00100000:2.0:1790656429.556926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790656429.556934:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719936:12345-0@lo:502: 00000100:00100000:2.0:1790656429.557173:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269719936:12345-0@lo:502: Request processed in 237us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656429.557180:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790656429.557391:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269719936:0@lo:502: 00000040:00080000:3.0:1790656429.557553:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790656429.557566:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1790656429.558219:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790656429.558232:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94393c8999c0) 00000020:00000080:2.0:1790656429.558314:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1790656429.558376:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94392d856000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790656429.558380:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94392d856000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790656429.558382:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94392d856000 3 00010000:00080000:2.0:1790656429.558409:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94393c8ae000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1790656429.561221:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1790656429.561664:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790656429.561769:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790656429.561784:0:6711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c3a6e82066ea953 00000100:00080000:3.0:1790656429.561794:0:6711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790656429.561805:0:6711:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94393c8ae000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656429.561839:0:6711:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff943935111180 x1877639269720064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790656429.561912:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269720064:0@lo:38: 00000100:00100000:1.0:1790656429.561976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790656429.562039:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790656429.562186:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720064 00000100:00100000:2.0:1790656429.562194:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720064 00000100:00100000:2.0:1790656429.562232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656429.562240:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269720064:12345-0@lo:38: 00010000:00080000:2.0:1790656429.562271:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:2.0:1790656429.562298:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c3a6e82066ea95a 00000004:00100000:2.0:1790656429.562311:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790656429.562337:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9439072db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656429.564903:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656429.564921:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269720192:0@lo:400: 00000100:00100000:0.0:1790656429.564975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656429.565036:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790656429.565044:0:5843:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790656429.565403:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720192 00000100:00100000:3.0:1790656429.565411:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720192 00000100:00100000:3.0:1790656429.565446:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790656429.565455:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656429.565462:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269720192:12345-0@lo:400: 00000100:00100000:3.0:1790656429.565540:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269720192:12345-0@lo:400: Request processed in 77us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.565547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790656429.565606:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393bf9b480 x1877639269720192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656429.565621:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269720192:0@lo:400: 00000040:00080000:0.0:1790656429.565822:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1790656429.566109:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1790656429.566137:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790656429.566159:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.566170:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790656429.566227:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790656429.566229:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790656429.566231:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656429.566232:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656429.566233:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656429.566234:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656429.566236:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656429.566237:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790656429.566238:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790656429.566240:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656429.566241:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790656429.566254:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1790656429.566256:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790656429.566258:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790656429.566259:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656429.566260:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656429.566261:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656429.566262:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656429.566263:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656429.566264:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790656429.566265:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790656429.566266:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656429.566267:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790656429.566285:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790656429.566295:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269720320:0@lo:253: 00000100:00100000:3.0:1790656429.566335:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.566361:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bfc8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656429.566843:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1877639269720064:12345-0@lo:38: Request processed in 4601us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656429.566852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656429.566886:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720320 00000100:00100000:2.0:1790656429.566892:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720320 00000100:00100000:2.0:1790656429.566929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790656429.566937:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6686:x1877639269720320:12345-0@lo:253: 20000000:01000000:2.0:1790656429.566959:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790656429.566973:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1790656429.567579:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff943935111180 x1877639269720064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656429.567609:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790656429.567618:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790656429.567633:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790656429.567638:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790656429.567642:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790656429.567649:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269720064:0@lo:38: 20000000:01000000:0.0:1790656429.596410:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790656429.596484:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790656429.601232:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790656429.601242:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790656429.601276:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.601295:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.601302:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.601341:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.601369:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 13 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.601383:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269720448:0@lo:104: 00000100:00100000:2.0:1790656429.601447:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656429.601555:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656429.605003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720448 00000100:00100000:1.0:1790656429.605017:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720448 00000100:00100000:1.0:1790656429.605073:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790656429.605083:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269720448:12345-0@lo:104: 00010000:00010000:1.0:1790656429.605101:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656429.605186:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790656429.605193:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269720448:12345-0@lo:104: Request processed in 112us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656429.605200:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790656429.605846:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656429.605855:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.605879:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ff000 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656429.605883:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.605892:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656429.605900:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656429.605906:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790656429.605983:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.605990:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656429.606018:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606026:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ff000/0x9c3a6e82066ea8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606042:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.606044:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656429.606045:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656429.606052:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656429.606068:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269720576:0@lo:103: 00000100:00100000:3.0:1790656429.606116:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656429.606158:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720576 00000100:00100000:3.0:1790656429.606163:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720576 00010000:00010000:3.0:1790656429.606191:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656429.606213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790656429.606219:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392878b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3301:x1877639269720576:12345-0@lo:103: 00010000:00010000:3.0:1790656429.606230:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656429.606234:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606343:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 14 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606361:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606370:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790656429.606384:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005142803s 00010000:00010000:3.0:1790656429.606389:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606395:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606402:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606409:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606414:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ffc00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656429.606423:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606430:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606438:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656429.606447:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656429.606578:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392878b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3301:x1877639269720576:12345-0@lo:103: Request processed in 359us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656429.606585:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790656429.606748:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148cc00/0x9c3a6e82066ea8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea8b9 expref: 13 pid: 5838 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656429.606761:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269720448:0@lo:104: 00010000:00010000:2.0:1790656429.606777:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.606785:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.606791:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656429.606797:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea961 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656429.608445:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:6686:x1877639269720320:12345-0@lo:253: Request processed in 41503us (42104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656429.608456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790656429.608790:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:6686:1877639269720320:0@lo:253: 10000000:01000000:3.0:1790656429.608802:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790656429.608804:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790656429.608806:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790656429.608807:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656429.608809:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656429.608810:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656429.608812:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656429.608813:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656429.608814:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790656429.608816:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790656429.608817:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656429.608818:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790656429.608832:0:6686:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790656429.610387:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269720576:0@lo:103: 00080000:10000000:3.0:1790656429.620561:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656429.621348:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656429.621870:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656429.622069:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656429.623055:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656429.623421:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790656429.625036:0:6686:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1790656429.795462:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790656429.831880:0:6686:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790656429.831887:0:6686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790656429.831920:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790656429.831971:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790656429.831986:0:6686:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790656429.832019:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790656430.816944:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656431.841520:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656432.862814:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656433.887749:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790656434.342708:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790656434.342716:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943928721000 from 21 10000000:01000000:2.0:1790656434.342722:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790656434.342766:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.342777:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.342800:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656434.342822:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720704:0@lo:101: 00000100:00100000:2.0:1790656434.342885:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.342938:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e2ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.343039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720704 00000100:00100000:3.0:1790656434.343047:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720704 00000100:00100000:3.0:1790656434.343099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790656434.343108:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269720704:12345-0@lo:101: 00010000:00010000:3.0:1790656434.343122:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656434.343134:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea968 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.343158:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.343168:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.343176:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c400, rc 0) 00000100:00100000:3.0:1790656434.343229:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269720704:12345-0@lo:101: Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.343235:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790656434.343530:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720704:0@lo:101: 00010000:00010000:2.0:1790656434.343544:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.343554:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656434.343638:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720832:0@lo:501: 00000100:00100000:2.0:1790656434.343666:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.343686:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e2ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.343740:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720832 00000100:00100000:3.0:1790656434.343745:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720832 00000100:00100000:3.0:1790656434.343775:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790656434.343783:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269720832:12345-0@lo:501: 00000100:00100000:3.0:1790656434.344093:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269720832:12345-0@lo:501: Request processed in 310us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.344101:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790656434.344133:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720832:0@lo:501: 00000100:00100000:3.0:1790656434.344160:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720960:0@lo:503: 00000100:00100000:3.0:1790656434.344201:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.344215:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.344226:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269720960 00000100:00100000:3.0:1790656434.344229:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269720960 00000100:00100000:3.0:1790656434.344245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790656434.344251:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269720960:12345-0@lo:503: 00000100:00100000:3.0:1790656434.344532:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269720960:12345-0@lo:503: Request processed in 279us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.344540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790656434.344574:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269720960:0@lo:503: 00000100:00100000:3.0:1790656434.344761:0:6967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6967:1877639269721088:0@lo:502: 00000100:00100000:3.0:1790656434.344792:0:6967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.344811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721088 00000100:00100000:3.0:1790656434.344815:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721088 00000100:00100000:3.0:1790656434.344832:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656434.344838:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6967:x1877639269721088:12345-0@lo:502: 00000100:00100000:3.0:1790656434.345008:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6967:x1877639269721088:12345-0@lo:502: Request processed in 170us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.345016:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656434.345042:0:6967:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.345054:0:6967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6967:1877639269721088:0@lo:502: 00000100:00100000:3.0:1790656434.345093:0:6967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6967:1877639269721216:0@lo:502: 00000100:00100000:3.0:1790656434.345124:0:6967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.345141:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721216 00000100:00100000:3.0:1790656434.345144:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721216 00000100:00100000:3.0:1790656434.345160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790656434.345173:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6967:x1877639269721216:12345-0@lo:502: 00000100:00100000:3.0:1790656434.345280:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:6967:x1877639269721216:12345-0@lo:502: Request processed in 107us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.345287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790656434.345312:0:6967:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.345323:0:6967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6967:1877639269721216:0@lo:502: 00000040:00080000:3.0:1790656434.345341:0:6967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790656434.345399:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790656434.345414:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790656434.345423:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345432:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656434.345440:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790656434.345442:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943928721000 from 4 10000000:01000000:3.0:1790656434.345445:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790656434.345469:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345477:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345498:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656434.345510:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721344:0@lo:101: 00000100:00100000:3.0:1790656434.345534:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.345554:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.345565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721344 00000100:00100000:3.0:1790656434.345569:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721344 00000100:00100000:3.0:1790656434.345585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790656434.345612:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269721344:12345-0@lo:101: 00010000:00010000:3.0:1790656434.345620:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656434.345633:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea976 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345652:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345662:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345670:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c800, rc 0) 00000100:00100000:3.0:1790656434.345699:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269721344:12345-0@lo:101: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.345705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790656434.345733:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721344:0@lo:101: 00010000:00010000:3.0:1790656434.345744:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.345753:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656434.345796:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721472:0@lo:256: 00000100:00100000:3.0:1790656434.345837:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.345850:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.345865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721472 00000100:00100000:3.0:1790656434.345869:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721472 00000100:00100000:3.0:1790656434.345885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790656434.345891:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269721472:12345-0@lo:256: 20000000:01000000:3.0:1790656434.345902:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790656434.345917:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790656434.345921:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790656434.345991:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269721472:12345-0@lo:256: Request processed in 99us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.345998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790656434.346025:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721472:0@lo:256: 10000000:01000000:3.0:1790656434.346063:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790656434.346069:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346077:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656434.346084:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790656434.346086:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790656434.346089:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790656434.346102:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346110:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346118:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656434.346138:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721600:0@lo:101: 00000100:00100000:3.0:1790656434.346162:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.346173:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.346184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721600 00000100:00100000:3.0:1790656434.346187:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721600 00000100:00100000:3.0:1790656434.346203:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790656434.346209:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269721600:12345-0@lo:101: 00010000:00010000:3.0:1790656434.346215:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656434.346222:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea984 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346235:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346242:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346248:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148ca00, rc 0) 00000100:00100000:3.0:1790656434.346273:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269721600:12345-0@lo:101: Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.346278:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790656434.346304:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721600:0@lo:101: 00010000:00010000:3.0:1790656434.346314:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656434.346321:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656434.346372:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721728:0@lo:501: 00000100:00100000:3.0:1790656434.346394:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.346407:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.346417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721728 00000100:00100000:3.0:1790656434.346420:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721728 00000100:00100000:3.0:1790656434.346435:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790656434.346439:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269721728:12345-0@lo:501: 00000100:00100000:3.0:1790656434.346674:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269721728:12345-0@lo:501: Request processed in 233us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.346681:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790656434.346709:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721728:0@lo:501: 00000100:00100000:3.0:1790656434.346730:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721856:0@lo:503: 00000100:00100000:3.0:1790656434.346762:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.346775:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.346785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721856 00000100:00100000:3.0:1790656434.346789:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721856 00000100:00100000:3.0:1790656434.346804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790656434.346809:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269721856:12345-0@lo:503: 00000100:00100000:3.0:1790656434.347072:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269721856:12345-0@lo:503: Request processed in 261us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.347079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790656434.347114:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269721856:0@lo:503: 00000100:00100000:0.0:1790656434.365822:0:6968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6968:1877639269721984:0@lo:502: 00000100:00100000:0.0:1790656434.365982:0:6968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656434.366039:0:6968:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.367431:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269721984 00000100:00100000:3.0:1790656434.367441:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269721984 00000100:00100000:3.0:1790656434.367512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790656434.367523:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:6968:x1877639269721984:12345-0@lo:502: 00000100:00100000:3.0:1790656434.367936:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:6968:x1877639269721984:12345-0@lo:502: Request processed in 414us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.367944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790656434.368102:0:6968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6968:1877639269721984:0@lo:502: 00000020:01000000:0.0:1790656434.368139:0:6968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790656434.368152:0:6968:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790656434.368159:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656434.368161:0:6968:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790656434.368166:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790656434.368170:0:6968:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:0.0:1790656434.368190:0:6968:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790656434.368193:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656434.368208:0:6968:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94393c9c3380) 00000020:00000080:0.0:1790656434.371570:0:6968:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1790656434.371587:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790656434.371701:0:6968:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790656434.371708:0:6968:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790656434.371715:0:6968:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ea999 00010000:00080000:0.0:1790656434.371751:0:6968:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943928640800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1790656434.371970:0:6968:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790656434.413324:0:6968:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790656434.413347:0:6968:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790656434.414083:0:6968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656434.414240:0:6968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656434.414289:0:6968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790656434.414348:0:6968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790656434.422838:0:6978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656434.422845:0:6978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790656434.423273:0:6968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790656434.423285:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790656434.423316:0:6968:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790656434.423336:0:6968:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ea9a0 00000100:00080000:2.0:1790656434.423344:0:6968:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790656434.423356:0:6968:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff943928640800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656434.423399:0:6968:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bfa0a80 x1877639269722112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656434.423430:0:6968:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1790656434.423492:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269722112:0@lo:8: 00000020:01000000:2.0:1790656434.423500:0:6968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656434.423503:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656434.423504:0:6968:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790656434.423507:0:6968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656434.423510:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656434.423511:0:6968:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790656434.423514:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790656434.423515:0:6968:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790656434.423535:0:6968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6968:1877639269722240:0@lo:502: 00000100:00100000:1.0:1790656434.423554:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.423575:0:6968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.423620:0:6968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656434.423637:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722240 00000100:00100000:2.0:1790656434.423643:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722240 00000100:00100000:2.0:1790656434.423686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790656434.423694:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:6968:x1877639269722240:12345-0@lo:502: 00000100:00100000:2.0:1790656434.423901:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:6968:x1877639269722240:12345-0@lo:502: Request processed in 206us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.423909:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790656434.423997:0:6968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:6968:1877639269722240:0@lo:502: 00000020:01000000:1.0:1790656434.424021:0:6968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656434.424030:0:6968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656434.424032:0:6968:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790656434.424035:0:6968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1790656434.424162:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1790656434.424181:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790656434.424189:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.424200:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656434.424209:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722112 00000100:00100000:3.0:1790656434.424214:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722112 10000000:01000000:2.0:1790656434.424220:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790656434.424222:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94390a368000 from 1 10000000:01000000:2.0:1790656434.424226:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1790656434.424232:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656434.424237:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1877639269722112:12345-0@lo:8: 00010000:00010000:2.0:1790656434.424246:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.424253:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790656434.424255:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00010000:00010000:2.0:1790656434.424262:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656434.424272:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269722624:0@lo:101: 00000020:00000080:3.0:1790656434.424276:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ea9ae 00002000:00100000:3.0:1790656434.424303:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff943925522000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790656434.424308:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:2.0:1790656434.424310:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:3.0:1790656434.424311:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1790656434.424330:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6840 going to sleep for 11 seconds 00000100:00100000:2.0:1790656434.424345:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269722496:0@lo:400: 00000100:00100000:2.0:1790656434.424367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.424385:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656434.424390:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269722368:0@lo:400: 00002000:00100000:3.0:1790656434.424430:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1790656434.424555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1790656434.424576:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1790656434.424583:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722624 00000100:00100000:2.0:1790656434.424587:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722624 00000100:00080000:3.0:1790656434.424615:0:6690:0:(import.c:65:import_set_state_nolock()) ffff943925520000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656434.424657:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1877639269722112:12345-0@lo:8: Request processed in 418us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.424663:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790656434.424697:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa0a80 x1877639269722112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790656444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656434.424706:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790656434.424713:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790656434.424720:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1790656434.424720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1790656434.424724:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:2.0:1790656434.424726:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269722624:12345-0@lo:101: 00000100:00080000:3.0:1790656434.424731:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943928640800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:2.0:1790656434.424735:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1790656434.424739:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790656434.424744:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269722112:0@lo:8: 00010000:00010000:2.0:1790656434.424747:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656434.424761:0:6978:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1790656434.424774:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.424784:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.424792:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013ffc00, rc 0) 00000100:00100000:2.0:1790656434.424819:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269722624:12345-0@lo:101: Request processed in 93us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.424824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1790656434.424841:0:6978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 149561249083ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790656434.424848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722496 00000100:00100000:2.0:1790656434.424851:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722496 00000100:00100000:2.0:1790656434.424879:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722368 00000100:00100000:2.0:1790656434.424881:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722368 00000100:00100000:2.0:1790656434.424896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656434.424902:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269722496:12345-0@lo:400: 00000100:00100000:2.0:1790656434.424936:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269722496:12345-0@lo:400: Request processed in 34us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.424941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656434.424952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656434.424956:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269722368:12345-0@lo:400: 00000100:00100000:2.0:1790656434.424979:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269722368:12345-0@lo:400: Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.424985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656434.425009:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269722624:0@lo:101: 00010000:00010000:2.0:1790656434.425021:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.425034:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656434.425074:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269722752:0@lo:501: 00000100:00100000:2.0:1790656434.425097:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656434.425115:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d6840 going to sleep for 11 seconds 00000100:00080000:2.0:1790656434.425126:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790656434.425153:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943935113100 x1877639269722368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656434.425164:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269722368:0@lo:400: 00010000:00080000:2.0:1790656434.425173:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943935111f80 x1877639269722496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656434.425181:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269722496:0@lo:400: 00000100:00100000:2.0:1790656434.425199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722752 00000100:00100000:2.0:1790656434.425203:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722752 00000100:00100000:2.0:1790656434.425228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790656434.425234:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269722752:12345-0@lo:501: 00000100:00100000:2.0:1790656434.427678:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269722752:12345-0@lo:501: Request processed in 2433us (2569us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790656434.427692:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790656434.427746:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269722752:0@lo:501: 10000000:01000000:2.0:1790656434.427783:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790656434.427792:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656434.427815:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656434.457128:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790656434.500434:0:6979:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790656434.500468:0:6979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723008:0@lo:7: 00000100:00100000:3.0:1790656434.500545:0:6979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.500607:0:6979:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61900 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.500646:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790656434.500656:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269722880:0@lo:13: 00000100:00100000:3.0:1790656434.500680:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.500710:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723008 00000100:00100000:3.0:1790656434.500717:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723008 00000100:00100000:3.0:1790656434.500765:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790656434.500773:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6979:x1877639269723008:12345-0@lo:7: 00000100:00100000:2.0:1790656434.502706:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269722880 00000100:00100000:2.0:1790656434.502717:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269722880 00000100:00100000:2.0:1790656434.507568:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656434.507586:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1877639269722880:12345-0@lo:13: 00002000:00000024:2.0:1790656434.507631:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790656434.507737:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1877639269722880:12345-0@lo:13: Request processed in 157us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.507744:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790656434.507762:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943935110000 x1877639269722880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656434.507784:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269722880:0@lo:13: 00000100:00080000:3.0:1790656434.507816:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1790656434.508063:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790656434.508775:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790656434.508843:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6979:x1877639269723008:12345-0@lo:7: Request processed in 8068us (8296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.508852:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790656434.508891:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943935112300 x1877639269723008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790656450 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656434.508908:0:6979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723008:0@lo:7: 00000004:00080000:3.0:1790656434.508921:0:6979:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790656434.508956:0:6979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723136:0@lo:5: 00000100:00100000:3.0:1790656434.508995:0:6979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656434.509030:0:6979:0:(client.c:2716:ptlrpc_set_wait()) set ffff943802b61900 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.509051:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723136 00000100:00100000:3.0:1790656434.509057:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723136 00000100:00100000:3.0:1790656434.509093:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656434.509101:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6979:x1877639269723136:12345-0@lo:5: 00002000:00080000:3.0:1790656434.509121:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790656434.509129:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790656434.509873:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6979:x1877639269723136:12345-0@lo:5: Request processed in 771us (880us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790656434.509880:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790656434.509961:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943935112300 x1877639269723136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790656450 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656434.509975:0:6979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723136:0@lo:5: 00000004:00080000:1.0:1790656434.509985:0:6979:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790656434.510016:0:6979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723264:0@lo:700: 00000100:00100000:1.0:1790656434.510044:0:6979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656434.510067:0:6979:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e37540 going to sleep for 11 seconds 00000100:00100000:0.0:1790656434.510123:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723264 00000100:00100000:0.0:1790656434.510128:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723264 00000100:00100000:0.0:1790656434.510164:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656434.510172:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6979:x1877639269723264:12345-0@lo:700: 00000100:00100000:0.0:1790656434.510201:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1877639269723392:0@lo:700: 00000100:00100000:0.0:1790656434.510232:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656434.510265:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.513202:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723392 00000100:00100000:3.0:1790656434.513217:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723392 00000100:00100000:3.0:1790656434.513265:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656434.513274:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1877639269723392:12345-0@lo:700: 40000000:02000000:3.0:1790656434.559952:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790656434.568401:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1877639269723392:12345-0@lo:700: Request processed in 55121us (58160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656434.568414:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790656434.568579:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bf99c00 x1877639269723392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790656450 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656434.568615:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1877639269723392:0@lo:700: 40000000:02000000:1.0:1790656434.568629:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1790656434.669541:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1790656434.669558:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790656434.669779:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6979:x1877639269723264:12345-0@lo:700: Request processed in 159599us (159725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656434.669795:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790656434.669886:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94391f47fb80 x1877639269723264/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790656450 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656434.669897:0:6979:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790656434.669912:0:6979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723264:0@lo:700: 00000004:02000040:1.0:1790656434.699083:0:6979:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1790656434.707049:0:6979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723520:0@lo:5: 00000100:00100000:1.0:1790656434.707110:0:6979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656434.707163:0:6979:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e37d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656434.707280:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723520 00000100:00100000:3.0:1790656434.707297:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723520 00000100:00100000:3.0:1790656434.707351:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656434.707361:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6979:x1877639269723520:12345-0@lo:5: 00002000:00080000:2.0:1790656434.712176:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790656434.712196:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790656434.717754:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6979:x1877639269723520:12345-0@lo:5: Request processed in 10388us (10637us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790656434.717769:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790656434.717885:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94391f47fb80 x1877639269723520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790656450 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656434.717907:0:6979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1877639269723520:0@lo:5: 00000004:00080000:0.0:1790656434.717921:0:6979:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1790656434.915635:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656435.902938:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790656435.934793:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656436.965949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656437.982794:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656439.010361:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656439.455097:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269723904:0@lo:400: 00000100:00100000:2.0:1790656439.455161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656439.455210:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656439.455216:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269723776:0@lo:400: 00000100:00100000:2.0:1790656439.455237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656439.455266:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723904 00000100:00100000:2.0:1790656439.455273:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723904 00000100:00100000:2.0:1790656439.455330:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723776 00000100:00100000:2.0:1790656439.455333:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723776 00000100:00100000:2.0:1790656439.455353:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656439.455361:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269723904:12345-0@lo:400: 00000100:00100000:2.0:1790656439.455423:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269723904:12345-0@lo:400: Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656439.455430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656439.455455:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790656439.455461:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269723776:12345-0@lo:400: 00000100:00080000:3.0:1790656439.455671:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656439.457142:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269723648:0@lo:400: 00000100:00100000:0.0:1790656439.457316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656439.457730:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656439.457742:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269724032:0@lo:400: 00000100:00100000:0.0:1790656439.457776:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656439.457817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269723648 00000100:00100000:0.0:1790656439.457823:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269723648 00000100:00100000:0.0:1790656439.457863:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790656439.458020:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3302:x1877639269723648:12345-0@lo:400: 00000100:00100000:0.0:1790656439.458074:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3302:x1877639269723648:12345-0@lo:400: Request processed in 126us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656439.458081:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790656439.458116:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724032 00000100:00100000:0.0:1790656439.458120:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724032 00000100:00100000:0.0:1790656439.458153:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656439.458159:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269724032:12345-0@lo:400: 00000100:00100000:0.0:1790656439.458320:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269724032:12345-0@lo:400: Request processed in 160us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656439.458326:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790656439.458347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790656439.458437:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa0a80 x1877639269724032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656439.458525:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269724032:0@lo:400: 00000100:00100000:0.0:1790656439.458539:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269723648:0@lo:400: 00000100:00100000:2.0:1790656439.458618:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269723776:12345-0@lo:400: Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656439.458631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790656439.458676:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa2d80 x1877639269723776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656439.458687:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269723776:0@lo:400: 00010000:00080000:2.0:1790656439.458699:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa2300 x1877639269723904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656439.458707:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269723904:0@lo:400: 00000100:00100000:0.0:1790656439.970923:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269724160:0@lo:13: 00000100:00100000:0.0:1790656439.970996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656439.971085:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724160 00000100:00100000:0.0:1790656439.971093:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724160 00000100:00100000:0.0:1790656439.971134:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656439.971143:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269724160:12345-0@lo:13: 00002000:00000024:0.0:1790656439.971173:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656439.971219:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269724160:12345-0@lo:13: Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656439.971225:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790656439.971267:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94391f47df80 x1877639269724160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656439.971287:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269724160:0@lo:13: 00010000:00010000:0.0:1790656440.037831:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790656440.043502:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1790656441.055336:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656442.080860:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656443.103130:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656444.126782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656444.575927:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269724288:0@lo:400: 00000100:00100000:0.0:1790656444.576004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656444.576165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724288 00000100:00100000:1.0:1790656444.576174:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724288 00000100:00100000:1.0:1790656444.576222:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790656444.576239:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3299:x1877639269724288:12345-0@lo:400: 00000100:00100000:2.0:1790656444.576420:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269724416:0@lo:400: 00000100:00100000:2.0:1790656444.576452:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656444.576481:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269724544:0@lo:400: 00000100:00100000:2.0:1790656444.576502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656444.576517:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656444.576523:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269724672:0@lo:400: 00000100:00100000:2.0:1790656444.576563:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656444.576609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724416 00000100:00100000:2.0:1790656444.576614:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724416 00000100:00100000:2.0:1790656444.576640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724544 00000100:00100000:2.0:1790656444.576644:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724544 00000100:00100000:2.0:1790656444.576670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656444.576676:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269724416:12345-0@lo:400: 00000100:00100000:2.0:1790656444.576713:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269724416:12345-0@lo:400: Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656444.576720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656444.576738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790656444.576744:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269724544:12345-0@lo:400: 00000100:00100000:2.0:1790656444.576776:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269724544:12345-0@lo:400: Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656444.576782:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790656444.576803:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724672 00000100:00100000:2.0:1790656444.576806:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724672 00000100:00100000:2.0:1790656444.576835:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656444.576843:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269724672:12345-0@lo:400: 00000100:00100000:2.0:1790656444.576875:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269724672:12345-0@lo:400: Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656444.576881:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790656444.576899:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656444.576904:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790656444.576931:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa2d80 x1877639269724416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656444.576946:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269724416:0@lo:400: 00010000:00080000:2.0:1790656444.576984:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa1180 x1877639269724672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656444.576992:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790656444.577003:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269724672:0@lo:400: 00010000:00080000:2.0:1790656444.577012:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa1880 x1877639269724544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656444.577019:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269724544:0@lo:400: 00000100:00100000:1.0:1790656444.585698:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3299:x1877639269724288:12345-0@lo:400: Request processed in 9452us (9685us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656444.585712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790656444.586577:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269724288:0@lo:400: 00000100:00100000:3.0:1790656445.090365:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656445.090389:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269724800:0@lo:13: 00000100:00100000:3.0:1790656445.090462:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656445.093866:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724800 00000100:00100000:1.0:1790656445.093881:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724800 00000100:00100000:1.0:1790656445.093930:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790656445.093940:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269724800:12345-0@lo:13: 00002000:00000024:1.0:1790656445.093976:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656445.094048:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269724800:12345-0@lo:13: Request processed in 109us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656445.094054:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790656445.094304:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94391f47fb80 x1877639269724800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656445.094324:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269724800:0@lo:13: 00010000:00010000:0.0:1790656445.153490:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656446.174796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790656446.801316:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790656446.801320:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790656446.801719:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94390a3a0800 00000020:01000004:3.0:1790656446.801736:0:7628:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790656446.801747:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790656446.801760:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9439281099c0) 00000020:00000080:3.0:1790656446.801776:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790656446.838005:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790656446.838362:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790656446.873302:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790656446.878191:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790656446.878222:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790656446.878273:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790656446.878294:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790656446.878652:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790656446.878664:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790656446.878673:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c3a6e82066ea9c3 00000020:01000004:3.0:1790656446.878680:0:7628:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790656446.878700:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790656446.878710:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790656446.878715:0:7628:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790656446.878735:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790656446.878738:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790656446.895083:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790656446.895114:0:7628:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790656446.895118:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790656446.895122:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656446.895123:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656446.895125:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656446.895126:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656446.895127:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656446.895128:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656446.895129:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656446.895131:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656446.895132:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656446.895133:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790656446.895137:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790656446.895139:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790656446.895140:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656446.895141:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656446.895142:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656446.895143:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656446.895144:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656446.895145:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656446.895146:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656446.895147:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656446.895148:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656446.895149:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790656446.895172:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790656446.895187:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269724928:0@lo:253: 00000100:00100000:0.0:1790656446.895248:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.895384:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439032299c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656446.895460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269724928 00000100:00100000:3.0:1790656446.895468:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269724928 00000100:00100000:3.0:1790656446.895566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790656446.895575:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:7628:x1877639269724928:12345-0@lo:253: 20000000:01000000:3.0:1790656446.895634:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790656446.895638:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1790656446.895643:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1790656446.895647:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1790656446.896449:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656446.896674:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790656446.896686:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1790656446.896723:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790656446.896731:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1790656446.896757:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790656446.896805:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790656446.897138:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790656446.897153:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1790656446.897155:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1790656446.897182:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790656446.897188:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790656446.897223:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790656446.897230:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1790656446.897254:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790656446.897261:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790656446.897284:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790656446.897336:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790656446.898092:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1790656446.898115:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1790656446.898117:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1790656446.898153:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1790656446.898160:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790656446.898189:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1790656446.898195:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1790656446.898224:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1790656446.898232:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790656446.898299:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1790656446.898340:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1790656446.898356:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790656446.898358:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790656446.898361:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790656446.898373:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790656446.898376:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790656446.898680:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790656446.898683:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790656446.899329:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790656446.899384:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790656446.899454:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790656446.899948:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790656446.899991:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790656446.900051:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1790656446.900063:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790656446.900065:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790656446.900416:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790656446.900696:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790656446.900733:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790656446.900791:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790656446.900803:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790656446.900805:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790656446.901292:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790656446.901337:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790656446.901404:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790656446.901750:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1790656446.901791:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1790656446.901897:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1790656446.901910:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790656446.901912:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790656446.907357:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1790656446.907473:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1790656446.908462:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790656446.908854:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790656446.908917:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790656446.908978:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790656446.908994:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790656446.908996:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790656446.909005:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790656446.909024:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909042:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909050:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909058:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909065:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909071:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909078:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909115:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909130:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656446.909154:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725056:0@lo:104: 00000100:00100000:3.0:1790656446.909215:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790656446.909258:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909266:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 16 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656446.909287:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725184:0@lo:104: 00010000:00010000:3.0:1790656446.909310:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909318:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 16 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656446.909326:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725312:0@lo:104: 00010000:00010000:3.0:1790656446.909357:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909366:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 16 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656446.909374:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935110e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725440:0@lo:104: 00010000:00010000:3.0:1790656446.909408:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656446.909416:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 16 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656446.909436:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725568:0@lo:104: 00000100:00100000:3.0:1790656446.909454:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790656446.909638:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790656446.909668:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.909692:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.909701:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.909709:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.909720:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725056 00000100:00100000:0.0:1790656446.909726:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725056 00000100:00100000:0.0:1790656446.909756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725184 00000100:00100000:0.0:1790656446.909758:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725184 00000100:00100000:0.0:1790656446.909766:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725312 00000100:00100000:0.0:1790656446.909768:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725312 00000100:00100000:0.0:1790656446.909788:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725440 00000100:00100000:0.0:1790656446.909791:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725440 00000100:00100000:0.0:1790656446.909806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725568 00000100:00100000:0.0:1790656446.909808:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725568 00000100:00100000:0.0:1790656446.909833:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656446.909843:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a35bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:5838:x1877639269725056:12345-0@lo:104: 00010000:00010000:0.0:1790656446.909856:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.909920:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656446.909926:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a35bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:5838:x1877639269725056:12345-0@lo:104: Request processed in 86us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.909933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656446.909966:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656446.909972:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5838:x1877639269725184:12345-0@lo:104: 00010000:00010000:0.0:1790656446.909980:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910015:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790656446.910020:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:5838:x1877639269725184:12345-0@lo:104: Request processed in 49us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.910026:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656446.910038:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656446.910044:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:5838:x1877639269725312:12345-0@lo:104: 00010000:00010000:0.0:1790656446.910051:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910078:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790656446.910087:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:5838:x1877639269725312:12345-0@lo:104: Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.910094:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656446.910108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790656446.910113:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:5838:x1877639269725440:12345-0@lo:104: 00010000:00010000:0.0:1790656446.910121:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910150:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790656446.910154:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:5838:x1877639269725440:12345-0@lo:104: Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.910159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790656446.910170:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790656446.910175:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269725568:12345-0@lo:104: 00010000:00010000:0.0:1790656446.910182:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910206:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790656446.910210:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5838:x1877639269725568:12345-0@lo:104: Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.910216:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790656446.910232:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790656446.910238:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910246:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ff400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656446.910250:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910268:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656446.910275:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656446.910282:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656446.910308:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910314:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656446.910330:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910337:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ff400/0x9c3a6e82066ea9a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910372:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790656446.910376:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910382:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148ce00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656446.910385:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910402:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656446.910408:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656446.910418:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656446.910436:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910441:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656446.910465:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910472:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94390148ce00/0x9c3a6e82066ea984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910484:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790656446.910487:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910492:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013fe400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656446.910495:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910502:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656446.910508:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656446.910513:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656446.910526:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910532:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656446.910544:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013fe400/0x9c3a6e82066ea968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea96f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910562:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656446.910565:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910571:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce000 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656446.910574:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910580:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656446.910586:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656446.910613:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656446.910627:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910632:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656446.910637:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910643:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439421ce000/0x9c3a6e82066ea93e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea945 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910653:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656446.910663:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ff600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656446.910672:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910678:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656446.910685:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656446.910690:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656446.910704:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910709:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656446.910714:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910720:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ff600/0x9c3a6e82066ea914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea91b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.910734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656446.910735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656446.910737:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656446.910751:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269726080:0@lo:103: 00000100:00100000:0.0:1790656446.910781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.910814:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790656446.910819:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269725696:0@lo:103: 00000100:00100000:0.0:1790656446.910849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.910867:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269726208:0@lo:103: 00000100:00100000:0.0:1790656446.910887:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656446.910989:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726080 00000100:00100000:0.0:1790656446.910994:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726080 00010000:00010000:0.0:1790656446.911016:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 17 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656446.911031:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725696 00000100:00100000:0.0:1790656446.911034:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725696 00010000:00010000:0.0:1790656446.911044:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 18 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656446.911054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726208 00000100:00100000:0.0:1790656446.911057:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726208 00010000:00010000:0.0:1790656446.911066:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 19 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656446.911078:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656446.911084:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269726080:12345-0@lo:103: 00010000:00010000:0.0:1790656446.911095:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656446.911100:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 19 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911109:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 19 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911123:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656446.911153:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269726080:12345-0@lo:103: Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.911168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656446.911183:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656446.911190:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3299:x1877639269725696:12345-0@lo:103: 00010000:00010000:0.0:1790656446.911198:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656446.911202:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 18 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911211:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 18 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911220:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656446.911243:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3299:x1877639269725696:12345-0@lo:103: Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.911249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656446.911261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656446.911267:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3299:x1877639269726208:12345-0@lo:103: 00010000:00010000:0.0:1790656446.911275:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656446.911279:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 17 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911287:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 17 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656446.911296:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656446.911319:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3299:x1877639269726208:12345-0@lo:103: Request processed in 52us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656446.911324:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656446.911359:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269725696:0@lo:103: 00000100:00100000:0.0:1790656446.911378:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269726208:0@lo:103: 00000100:00100000:0.0:1790656446.911386:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269726080:0@lo:103: 00010000:00010000:2.0:1790656446.911743:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656446.911765:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269725952:0@lo:103: 00000100:00100000:2.0:1790656446.911796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656446.911837:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656446.911843:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269725824:0@lo:103: 00000100:00100000:2.0:1790656446.911863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656446.911885:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725952 00000100:00100000:2.0:1790656446.911889:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725952 00010000:00010000:2.0:1790656446.911906:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 17 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.911920:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269725824 00000100:00100000:2.0:1790656446.911923:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269725824 00010000:00010000:2.0:1790656446.911949:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 18 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.911964:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656446.911971:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3302:x1877639269725952:12345-0@lo:103: 00010000:00010000:2.0:1790656446.911987:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656446.911991:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 18 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912000:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 18 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912010:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656446.912039:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3302:x1877639269725952:12345-0@lo:103: Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656446.912045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656446.912062:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656446.912068:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3302:x1877639269725824:12345-0@lo:103: 00010000:00010000:2.0:1790656446.912075:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656446.912079:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 17 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912088:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 17 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912099:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912108:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912122:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912129:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912142:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912149:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912155:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656446.912159:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912167:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912176:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912185:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656446.912209:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3302:x1877639269725824:12345-0@lo:103: Request processed in 142us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656446.912215:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656446.912242:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269725824:0@lo:103: 00000100:00100000:2.0:1790656446.912249:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269725952:0@lo:103: 00010000:00010000:2.0:1790656446.912444:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013ffc00/0x9c3a6e82066ea9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea9a7 expref: 16 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.912457:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725056:0@lo:104: 00010000:00010000:2.0:1790656446.912467:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148ca00/0x9c3a6e82066ea98b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea984 expref: 15 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.912490:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725184:0@lo:104: 00010000:00010000:2.0:1790656446.912503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c400/0x9c3a6e82066ea96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea968 expref: 14 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.912513:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725312:0@lo:104: 00010000:00010000:2.0:1790656446.912522:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421ce200/0x9c3a6e82066ea945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea93e expref: 13 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.912531:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935110e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725440:0@lo:104: 00010000:00010000:2.0:1790656446.912541:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900030a00/0x9c3a6e82066ea91b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea914 expref: 12 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656446.912551:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1877639269725568:0@lo:104: 00010000:00010000:2.0:1790656446.912571:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912580:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912586:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656446.912608:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c97600/0x9c3a6e82066ea9ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790656446.912622:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790656447.033430:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:7628:x1877639269724928:12345-0@lo:253: Request processed in 137845us (138170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.033462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790656447.033657:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269724928:0@lo:253: 10000000:01000000:0.0:1790656447.033673:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790656447.033676:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790656447.033677:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656447.033679:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656447.033680:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790656447.033681:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656447.033682:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656447.033683:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656447.033685:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790656447.033686:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656447.033687:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790656447.033707:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94390a3a0800 from lustre-OST0001 10000000:01000000:0.0:1790656447.033730:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790656447.033733:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790656447.033741:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94390a368000 local copy 10000000:01000000:0.0:1790656447.033745:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790656447.033784:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.033795:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.033805:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656447.034315:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726336:0@lo:101: 00000100:00100000:2.0:1790656447.034443:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.034492:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903229480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656447.034557:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726336 00000100:00100000:1.0:1790656447.034575:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726336 00000100:00100000:1.0:1790656447.034653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790656447.034664:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+11:7628:x1877639269726336:12345-0@lo:101: 00010000:00010000:1.0:1790656447.034676:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656447.034691:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cea00/0x9c3a6e82066ea9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea9d1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.034723:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cea00/0x9c3a6e82066ea9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9d1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.034733:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cea00/0x9c3a6e82066ea9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9d1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.034741:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cea00, rc 0) 00000100:00100000:1.0:1790656447.034786:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726336:12345-0@lo:101: Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656447.034793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790656447.035091:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726336:0@lo:101: 00010000:00010000:2.0:1790656447.035106:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.035116:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656447.035223:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726464:0@lo:501: 00000100:00100000:2.0:1790656447.035251:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.035283:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54840 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.035340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726464 00000100:00100000:0.0:1790656447.035351:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726464 00000100:00100000:0.0:1790656447.035386:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790656447.035403:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726464:12345-0@lo:501: 00000100:00100000:0.0:1790656447.035656:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726464:12345-0@lo:501: Request processed in 253us (403us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790656447.035663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790656447.035837:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726464:0@lo:501: 10000000:01000000:2.0:1790656447.035851:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790656447.035878:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790656447.035884:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.035894:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.035902:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.035923:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790656447.035944:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94390a3a0800 10000000:01000000:2.0:1790656447.035954:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790656447.035959:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790656447.035961:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656447.035966:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790656447.035969:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790656447.035989:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.035997:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.036007:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656447.036019:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726592:0@lo:101: 00000100:00100000:2.0:1790656447.036044:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.036075:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00000100:00100000:3.0:1790656447.036199:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726592 00000100:00100000:3.0:1790656447.036204:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726592 00000100:00100000:3.0:1790656447.036237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790656447.036244:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726592:12345-0@lo:101: 00010000:00010000:3.0:1790656447.036254:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656447.036265:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea9df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.036282:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.036291:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.036298:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656447.036328:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269726592:12345-0@lo:101: Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.036334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1790656447.036409:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656447.036416:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036424:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656447.036427:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036435:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656447.036441:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656447.036447:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656447.036466:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036472:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656447.036496:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036502:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066ea9d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c3a6e82066ea9d8 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036527:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656447.036528:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656447.036530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656447.036581:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269726720:0@lo:103: 00000100:00100000:3.0:1790656447.036640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656447.036914:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726720 00000100:00100000:0.0:1790656447.036920:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726720 00000100:00100000:0.0:1790656447.036950:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656447.036957:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3301:x1877639269726720:12345-0@lo:103: 00010000:00010000:0.0:1790656447.036967:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656447.036978:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cea00/0x9c3a6e82066ea9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066ea9d1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.036989:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656447.037023:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3301:x1877639269726720:12345-0@lo:103: Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.037030:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790656447.037101:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269726720:0@lo:103: 00000100:00100000:2.0:1790656447.037233:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726592:0@lo:101: 00010000:00010000:2.0:1790656447.037246:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.037255:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656447.037329:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726848:0@lo:501: 00000100:00100000:2.0:1790656447.037359:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.037382:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00000100:00100000:3.0:1790656447.037444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726848 00000100:00100000:3.0:1790656447.037448:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726848 00000100:00100000:3.0:1790656447.037476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790656447.037483:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726848:12345-0@lo:501: 00000100:00100000:3.0:1790656447.038018:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726848:12345-0@lo:501: Request processed in 534us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.038026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790656447.038143:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726848:0@lo:501: 00000100:00100000:2.0:1790656447.038172:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726976:0@lo:503: 00000100:00100000:2.0:1790656447.038212:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.038240:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.038286:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269726976 00000100:00100000:0.0:1790656447.038291:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269726976 00000100:00100000:0.0:1790656447.038321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790656447.038328:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726976:12345-0@lo:503: 00000100:00100000:0.0:1790656447.038491:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269726976:12345-0@lo:503: Request processed in 162us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.038498:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790656447.038678:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269726976:0@lo:503: 00000040:00080000:2.0:1790656447.039075:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790656447.039142:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727104:0@lo:502: 00000100:00100000:2.0:1790656447.039180:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.039211:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00000100:00100000:3.0:1790656447.039310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727104 00000100:00100000:3.0:1790656447.039315:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727104 00000100:00100000:3.0:1790656447.039347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790656447.039354:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269727104:12345-0@lo:502: 00000100:00100000:3.0:1790656447.039522:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269727104:12345-0@lo:502: Request processed in 167us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.039529:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790656447.039890:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727104:0@lo:502: 00000040:00080000:2.0:1790656447.040146:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790656447.040193:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790656447.040226:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790656447.040270:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790656447.040306:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790656447.040343:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790656447.040370:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727232:0@lo:502: 00000100:00100000:2.0:1790656447.040424:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.040500:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54180 going to sleep for 11 seconds 00000100:00100000:1.0:1790656447.047911:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727232 00000100:00100000:1.0:1790656447.047927:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727232 00000100:00100000:1.0:1790656447.047992:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790656447.048002:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269727232:12345-0@lo:502: 00000100:00100000:1.0:1790656447.051041:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269727232:12345-0@lo:502: Request processed in 3032us (10609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.051178:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727232:0@lo:502: 00000040:00080000:2.0:1790656447.051370:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790656447.051386:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1790656447.051687:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000020:01000000:2.0:1790656447.053140:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790656447.053149:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790656447.053157:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656447.053159:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790656447.053164:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790656447.053348:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94393c89b380) 00000020:00000080:2.0:1790656447.053370:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790656447.053377:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790656447.053474:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94390a3a0800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790656447.053482:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790656447.053489:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c3a6e82066ea9f4 00010000:00010000:2.0:1790656447.063496:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1790656447.063880:0:7636:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790656447.076951:0:7636:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790656447.077222:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790656447.089582:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790656447.090168:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790656447.103191:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790656447.103203:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656447.103209:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656447.103211:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790656447.103214:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656447.103218:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656447.103220:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790656447.103222:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790656447.103224:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790656447.103276:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656447.103279:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656447.103280:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790656447.103289:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790656447.103515:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790656447.103540:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790656447.103564:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.103584:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656447.105461:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94390a3a0800 from 1 10000000:01000000:1.0:1790656447.105469:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790656447.105514:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.105526:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.105536:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656447.105560:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727360:0@lo:101: 00000100:00100000:1.0:1790656447.105680:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656447.105733:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519000 going to sleep for 11 seconds 00000100:00100000:2.0:1790656447.106061:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727360 00000100:00100000:2.0:1790656447.106069:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727360 00000100:00100000:2.0:1790656447.106142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790656447.106151:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:7628:x1877639269727360:12345-0@lo:101: 00010000:00010000:2.0:1790656447.106162:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656447.106173:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ea9fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.106193:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.106203:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.106211:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013ff600, rc 0) 00000100:00100000:2.0:1790656447.106249:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727360:12345-0@lo:101: Request processed in 100us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.106263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790656447.106304:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727360:0@lo:101: 00010000:00010000:2.0:1790656447.106318:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.106327:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656447.106424:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727488:0@lo:501: 00000100:00100000:2.0:1790656447.106448:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.106459:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908df3600 going to sleep for 11 seconds 00000100:00100000:1.0:1790656447.106511:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727488 00000100:00100000:1.0:1790656447.106515:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727488 00000100:00100000:1.0:1790656447.106540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790656447.106546:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727488:12345-0@lo:501: 00000100:00100000:1.0:1790656447.106926:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727488:12345-0@lo:501: Request processed in 379us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656447.106934:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790656447.107771:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727488:0@lo:501: 00000100:00100000:2.0:1790656447.107814:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727616:0@lo:503: 00000100:00100000:2.0:1790656447.108792:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.109742:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908df3600 going to sleep for 11 seconds 00000100:00100000:1.0:1790656447.109887:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727616 00000100:00100000:1.0:1790656447.109896:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727616 00000100:00100000:1.0:1790656447.109946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790656447.109955:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727616:12345-0@lo:503: 00000100:00100000:1.0:1790656447.110320:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727616:12345-0@lo:503: Request processed in 366us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656447.110328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790656447.110516:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727616:0@lo:503: 00000040:00080000:2.0:1790656447.112168:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790656447.112244:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727744:0@lo:502: 00000100:00100000:2.0:1790656447.112310:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.112356:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e161480 going to sleep for 11 seconds 00000100:00100000:3.0:1790656447.115066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727744 00000100:00100000:3.0:1790656447.115081:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727744 00000100:00100000:3.0:1790656447.115143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790656447.115153:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727744:12345-0@lo:502: 00000100:00100000:3.0:1790656447.115440:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727744:12345-0@lo:502: Request processed in 288us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.115449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790656447.115716:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727744:0@lo:502: 00000040:00080000:2.0:1790656447.116006:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790656447.116060:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790656447.116095:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727872:0@lo:502: 00000100:00100000:2.0:1790656447.116140:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.116182:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e161480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.116781:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269727872 00000100:00100000:0.0:1790656447.116789:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269727872 00000100:00100000:0.0:1790656447.116831:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790656447.116839:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727872:12345-0@lo:502: 00000100:00100000:0.0:1790656447.116998:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269727872:12345-0@lo:502: Request processed in 159us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.117011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790656447.117192:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269727872:0@lo:502: 00000040:00080000:2.0:1790656447.117291:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790656447.117301:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790656447.124563:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656447.124578:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656447.124581:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790656447.124588:0:7640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94390a3a0800 00000020:00000080:2.0:1790656447.124617:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790656447.124639:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656447.124652:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656447.124654:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790656447.124657:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790656447.125163:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790656447.125188:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790656447.125214:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125227:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656447.125269:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790656447.125272:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94390a3a0800 10000000:01000000:0.0:1790656447.125276:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94390a3a0800 10000000:01000000:0.0:1790656447.125279:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790656447.125285:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94390a3a0800 from 1 10000000:01000000:0.0:1790656447.125288:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790656447.125322:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125330:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125340:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656447.125362:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728000:0@lo:101: 00000100:00100000:0.0:1790656447.125436:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656447.125489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728000 00000100:00100000:0.0:1790656447.125496:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728000 00000100:00100000:0.0:1790656447.125537:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790656447.125545:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269728000:12345-0@lo:101: 00010000:00010000:0.0:1790656447.125573:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656447.125585:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa09 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125630:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125641:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125660:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030800, rc 0) 00000100:00100000:0.0:1790656447.125695:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728000:12345-0@lo:101: Request processed in 150us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.125702:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790656447.125744:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b71840 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.125767:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728000:0@lo:101: 00010000:00010000:0.0:1790656447.125780:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.125789:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656447.125872:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728128:0@lo:501: 00000100:00100000:0.0:1790656447.125896:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656447.125916:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b71840 going to sleep for 11 seconds 00000100:00100000:2.0:1790656447.126767:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728128 00000100:00100000:2.0:1790656447.126777:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728128 00000100:00100000:2.0:1790656447.126819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790656447.126828:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728128:12345-0@lo:501: 00000100:00100000:2.0:1790656447.127096:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728128:12345-0@lo:501: Request processed in 269us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.127104:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790656447.130607:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728128:0@lo:501: 00000100:00100000:1.0:1790656447.130680:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728256:0@lo:503: 00000100:00100000:1.0:1790656447.130755:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656447.130787:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.131281:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728256 00000100:00100000:0.0:1790656447.131288:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728256 00000100:00100000:0.0:1790656447.131335:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790656447.131345:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728256:12345-0@lo:503: 00000100:00100000:0.0:1790656447.131572:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728256:12345-0@lo:503: Request processed in 228us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.131580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790656447.131796:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728256:0@lo:503: 00000040:00080000:1.0:1790656447.132115:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790656447.132179:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728384:0@lo:502: 00000100:00100000:1.0:1790656447.132221:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656447.132256:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656447.132302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728384 00000100:00100000:0.0:1790656447.132308:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728384 00000100:00100000:0.0:1790656447.132346:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790656447.132353:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728384:12345-0@lo:502: 00000100:00100000:0.0:1790656447.132543:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728384:12345-0@lo:502: Request processed in 189us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656447.132550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790656447.132733:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728384:0@lo:502: 00000040:00080000:1.0:1790656447.132953:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790656447.133002:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790656447.133038:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790656447.133087:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790656447.133125:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790656447.133178:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790656447.133213:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790656447.133242:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790656447.133292:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790656447.133331:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790656447.133368:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790656447.133431:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790656447.133470:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790656447.133502:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790656447.133546:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790656447.133580:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790656447.133667:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790656447.133719:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790656447.133754:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790656447.133803:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790656447.133855:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790656447.133892:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790656447.133927:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790656447.133976:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790656447.134017:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790656447.134053:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790656447.134101:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790656447.134138:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790656447.134174:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790656447.134223:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790656447.134256:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790656447.134286:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790656447.134316:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790656447.134358:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790656447.134429:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790656447.134480:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790656447.134514:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790656447.134559:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728512:0@lo:502: 00000100:00100000:1.0:1790656447.134670:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656447.134708:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656447.135121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728512 00000100:00100000:2.0:1790656447.135130:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728512 00000100:00100000:2.0:1790656447.135178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790656447.135187:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728512:12345-0@lo:502: 00000100:00100000:2.0:1790656447.135414:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269728512:12345-0@lo:502: Request processed in 228us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.135422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790656447.138327:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269728512:0@lo:502: 00000040:00080000:3.0:1790656447.138484:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1790656447.138498:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790656447.139244:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790656447.139266:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff943802ee0000) 00000020:00000080:3.0:1790656447.139287:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1790656447.139374:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94390a3a0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790656447.139379:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94390a3a0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790656447.139381:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94390a3a0800 3 00010000:00080000:3.0:1790656447.139430:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943802669000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1790656447.142484:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1790656447.142978:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790656447.143025:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790656447.143038:0:7641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c3a6e82066eaa1e 00000100:00080000:2.0:1790656447.143048:0:7641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790656447.143058:0:7641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff943802669000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656447.143091:0:7641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bfa2d80 x1877639269728640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656447.143119:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790656447.143200:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269728768:0@lo:400: 00000100:00100000:2.0:1790656447.143259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.143306:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269728896:0@lo:400: 00000100:00100000:2.0:1790656447.143328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.143345:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656447.143350:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269729024:0@lo:400: 00000100:00100000:2.0:1790656447.143371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.143411:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728768 00000100:00100000:2.0:1790656447.143418:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728768 00000100:00100000:2.0:1790656447.143452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728896 00000100:00100000:2.0:1790656447.143454:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728896 00000100:00100000:2.0:1790656447.143480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656447.143488:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269728768:12345-0@lo:400: 00000100:00100000:2.0:1790656447.143534:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269728768:12345-0@lo:400: Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.143541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656447.143553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656447.143559:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269728896:12345-0@lo:400: 00000100:00100000:2.0:1790656447.143587:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269728896:12345-0@lo:400: Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.143630:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656447.143670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729024 00000100:00100000:2.0:1790656447.143674:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729024 00000100:00100000:2.0:1790656447.143699:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656447.143706:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269729024:12345-0@lo:400: 00000100:00100000:2.0:1790656447.143736:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269729024:12345-0@lo:400: Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.143742:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790656447.143761:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656447.143765:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790656447.143811:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa0700 x1877639269729024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656447.143824:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269729024:0@lo:400: 00010000:00080000:2.0:1790656447.143834:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa3800 x1877639269728896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656447.143842:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269728896:0@lo:400: 00010000:00080000:2.0:1790656447.143942:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa0a80 x1877639269728768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656447.143950:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269728768:0@lo:400: 00000040:00080000:2.0:1790656447.144163:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1790656447.144312:0:7642:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff94393bfa0a80 x1877639269729152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656447.144321:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1619c0 going to sleep for 0 seconds 00000100:00100000:3.0:1790656447.144411:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269728640:0@lo:38: 00000100:00100000:3.0:1790656447.144451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656447.144744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269728640 00000100:00100000:2.0:1790656447.144751:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269728640 00000100:00100000:2.0:1790656447.144891:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656447.144897:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269728640:12345-0@lo:38: 00010000:00080000:2.0:1790656447.144919:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:2.0:1790656447.144950:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c3a6e82066eaa25 00000004:00100000:2.0:1790656447.144965:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790656447.144995:0:5844:0:(import.c:65:import_set_state_nolock()) ffff94392dada000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656447.145053:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1877639269728640:12345-0@lo:38: Request processed in 154us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.145060:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790656447.145124:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa2d80 x1877639269728640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656447.145133:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790656447.145140:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790656447.145147:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790656447.145152:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790656447.145154:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790656447.145159:0:3298:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006d056080): req@ffff94393bfa0a80 x1877639269729152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656447.145187:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269728640:0@lo:38: 00000020:01000000:0.0:1790656447.145270:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790656447.145303:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790656447.145366:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656447.145377:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790656447.145429:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790656447.145431:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656447.145432:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656447.145433:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656447.145434:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656447.145436:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656447.145437:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656447.145439:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656447.145440:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656447.145441:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656447.145442:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656447.145446:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790656447.145449:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790656447.145455:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656447.145456:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656447.145457:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656447.145457:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656447.145458:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656447.145459:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656447.145460:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656447.145461:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656447.145462:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656447.145463:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656447.145478:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790656447.145488:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269729280:0@lo:253: 00000100:00100000:0.0:1790656447.145527:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656447.145556:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439032299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656447.152530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729280 00000100:00100000:2.0:1790656447.152545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729280 00000100:00100000:2.0:1790656447.152632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790656447.152809:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:7628:x1877639269729280:12345-0@lo:253: 20000000:01000000:2.0:1790656447.152845:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790656447.152859:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790656447.153845:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656447.153882:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656447.153942:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729152 00000100:00100000:3.0:1790656447.153949:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729152 00000100:00100000:3.0:1790656447.154002:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656447.154011:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1877639269729152:12345-0@lo:901: 00000100:00100000:3.0:1790656447.154308:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1877639269729152:12345-0@lo:901: Request processed in 298us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.154315:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790656447.154410:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bfa0a80 x1877639269729152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790656463 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656447.154426:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1877639269729152:0@lo:901: 00000100:00080000:2.0:1790656447.162414:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656447.199426:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1790656447.204466:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790656447.204486:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790656447.204540:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790656447.204545:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790656447.204565:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.205167:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.205177:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.205214:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.205227:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 14 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656447.205348:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935110e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269729408:0@lo:104: 00000100:00100000:3.0:1790656447.205433:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656447.205522:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656447.205668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729408 00000100:00100000:1.0:1790656447.205676:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729408 00000100:00100000:1.0:1790656447.205817:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790656447.205826:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269729408:12345-0@lo:104: 00010000:00010000:1.0:1790656447.205840:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.205902:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790656447.205909:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:5859:x1877639269729408:12345-0@lo:104: Request processed in 85us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656447.205916:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790656447.205937:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656447.205943:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.205950:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148c200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656447.205955:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.205963:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656447.205981:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656447.205986:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790656447.206023:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.206034:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656447.206505:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.206515:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94390148c200/0x9c3a6e82066ea976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea97d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656447.206533:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656447.206535:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656447.206536:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656447.206548:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269729536:0@lo:103: 00000100:00100000:1.0:1790656447.206657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656447.206798:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729536 00000100:00100000:3.0:1790656447.206804:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729536 00010000:00010000:3.0:1790656447.206825:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 15 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656447.206902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790656447.206911:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392878a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:3301:x1877639269729536:12345-0@lo:103: 00010000:00010000:3.0:1790656447.206922:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656447.206928:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 15 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.206938:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 15 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.206955:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.206955:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c800/0x9c3a6e82066ea97d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea976 expref: 15 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.206964:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656447.206967:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935110e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1877639269729408:0@lo:104: 20000000:01000000:3.0:1790656447.206977:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005142803s 00010000:00010000:3.0:1790656447.206981:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.206984:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.206988:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.206994:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.207016:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.210133:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656447.210172:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.210516:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656447.210523:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.210534:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.210550:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.210559:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96e00/0x9c3a6e82066eaa2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656447.210582:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656447.210856:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392878a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3301:x1877639269729536:12345-0@lo:103: Request processed in 3943us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656447.210866:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656447.211168:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269729536:0@lo:103: 00000100:00100000:2.0:1790656447.220698:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:7628:x1877639269729280:12345-0@lo:253: Request processed in 68048us (75161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656447.220712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790656447.220740:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4906672e-e41b-4f99-9a3c-531aeecaa79a:7628:1877639269729280:0@lo:253: 10000000:01000000:0.0:1790656447.220756:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790656447.220760:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790656447.220761:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656447.220763:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656447.220764:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656447.220765:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656447.220767:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656447.220768:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656447.220770:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790656447.220771:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790656447.220773:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656447.220774:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790656447.220789:0:7628:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790656447.232015:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790656447.232262:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790656447.233933:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790656447.234179:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790656447.234410:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656447.236469:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790656447.242033:0:7628:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790656447.511851:0:7628:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790656447.511858:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790656447.511892:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790656447.511952:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790656447.511965:0:7628:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790656447.511991:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790656448.222842:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656449.248482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656450.206930:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269729664:0@lo:13: 00000100:00100000:2.0:1790656450.207001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656450.207184:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729664 00000100:00100000:1.0:1790656450.207192:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729664 00000100:00100000:1.0:1790656450.207254:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790656450.207263:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269729664:12345-0@lo:13: 00002000:00000024:1.0:1790656450.207297:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656450.207340:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269729664:12345-0@lo:13: Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656450.207346:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790656450.207410:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790656450.207438:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47ce00 x1877639269729664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656450.207454:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269729664:0@lo:13: 00010000:00010000:2.0:1790656450.271156:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656451.294832:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656452.256468:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269729792:0@lo:400: 00000100:00100000:0.0:1790656452.256540:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656452.256606:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269730304:0@lo:400: 00000100:00100000:0.0:1790656452.256635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656452.256664:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730304 00000100:00100000:2.0:1790656452.256673:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730304 00000100:00100000:2.0:1790656452.256727:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656452.256737:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269730304:12345-0@lo:400: 00000100:00100000:2.0:1790656452.256784:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269730304:12345-0@lo:400: Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656452.256797:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790656452.256816:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790656452.256827:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bf99880 x1877639269730304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656452.256840:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269730304:0@lo:400: 00000100:00100000:0.0:1790656452.256853:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656452.256859:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269729920:0@lo:400: 00000100:00100000:0.0:1790656452.256880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656452.256917:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269730176:0@lo:400: 00000100:00100000:0.0:1790656452.256958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656452.256980:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656452.256985:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269730048:0@lo:400: 00000100:00100000:0.0:1790656452.257004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656452.257063:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729920 00000100:00100000:2.0:1790656452.257068:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729920 00000100:00100000:2.0:1790656452.257091:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730048 00000100:00100000:2.0:1790656452.257094:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730048 00000100:00100000:2.0:1790656452.257114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656452.257119:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269729920:12345-0@lo:400: 00000100:00100000:2.0:1790656452.260712:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269729920:12345-0@lo:400: Request processed in 3583us (3821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656452.260726:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656452.261492:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656452.261507:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269730048:12345-0@lo:400: 00000100:00100000:2.0:1790656452.261940:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269730048:12345-0@lo:400: Request processed in 438us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656452.261948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790656452.261971:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790656452.262008:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bf98700 x1877639269730048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656452.262022:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269730048:0@lo:400: 00000100:00100000:0.0:1790656452.263547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269729792 00000100:00100000:0.0:1790656452.263559:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269729792 00000100:00100000:0.0:1790656452.263628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790656452.263638:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3299:x1877639269729792:12345-0@lo:400: 00000100:00100000:0.0:1790656452.263784:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3299:x1877639269729792:12345-0@lo:400: Request processed in 148us (7243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656452.263791:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790656452.263823:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730176 00000100:00100000:0.0:1790656452.263828:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730176 00000100:00100000:0.0:1790656452.263879:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656452.263886:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269730176:12345-0@lo:400: 00000100:00100000:0.0:1790656452.263927:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269730176:12345-0@lo:400: Request processed in 41us (6968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656452.263942:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790656452.263991:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bf9b800 x1877639269729920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656452.264005:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269729920:0@lo:400: 00000100:00100000:0.0:1790656452.264017:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269729792:0@lo:400: 00000100:00080000:2.0:1790656452.264262:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790656452.264288:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bf98a80 x1877639269730176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656452.264308:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269730176:0@lo:400: 00010000:00010000:2.0:1790656452.319798:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656453.247223:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790656453.348780:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790656453.793105:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790656453.793114:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94392d856000 from 30 10000000:01000000:0.0:1790656453.793120:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790656453.793163:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656453.793174:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656453.793186:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656453.793209:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730432:0@lo:101: 00000100:00100000:0.0:1790656453.793277:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656453.793332:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928002c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656453.793840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730432 00000100:00100000:2.0:1790656453.793859:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730432 00000100:00100000:2.0:1790656453.793902:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790656453.793910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269730432:12345-0@lo:101: 00010000:00010000:2.0:1790656453.793923:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656453.793934:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa33 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656453.793957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656453.793966:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656453.793975:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013fea00, rc 0) 00000100:00100000:2.0:1790656453.794020:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269730432:12345-0@lo:101: Request processed in 110us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656453.794026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790656453.794071:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730432:0@lo:101: 00010000:00010000:2.0:1790656453.794084:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656453.794092:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656453.794142:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730560:0@lo:501: 00000100:00100000:2.0:1790656453.794167:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.794188:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439351483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656453.794203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730560 00000100:00100000:2.0:1790656453.794207:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730560 00000100:00100000:2.0:1790656453.794237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790656453.794242:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269730560:12345-0@lo:501: 00000100:00100000:2.0:1790656453.794619:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269730560:12345-0@lo:501: Request processed in 374us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656453.794626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790656453.795049:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730560:0@lo:501: 00000100:00100000:2.0:1790656453.795080:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730688:0@lo:503: 00000100:00100000:2.0:1790656453.795121:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.795394:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439351483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.796967:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730688 00000100:00100000:1.0:1790656453.796981:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730688 00000100:00100000:1.0:1790656453.797030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790656453.797038:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269730688:12345-0@lo:503: 00000100:00100000:1.0:1790656453.797403:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269730688:12345-0@lo:503: Request processed in 364us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.797411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790656453.799277:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269730688:0@lo:503: 00000100:00100000:0.0:1790656453.807949:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8014:1877639269730816:0@lo:502: 00000100:00100000:0.0:1790656453.808027:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656453.808078:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928002300 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.808126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730816 00000100:00100000:3.0:1790656453.808134:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730816 00000100:00100000:3.0:1790656453.808183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790656453.808192:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8014:x1877639269730816:12345-0@lo:502: 00000100:00100000:3.0:1790656453.808549:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8014:x1877639269730816:12345-0@lo:502: Request processed in 356us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.808565:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790656453.811743:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8014:1877639269730816:0@lo:502: 00000100:00100000:0.0:1790656453.812071:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8014:1877639269730944:0@lo:502: 00000100:00100000:0.0:1790656453.812146:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656453.812191:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928002300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.812241:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269730944 00000100:00100000:1.0:1790656453.812249:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269730944 00000100:00100000:1.0:1790656453.812294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790656453.812303:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8014:x1877639269730944:12345-0@lo:502: 00000100:00100000:1.0:1790656453.812553:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8014:x1877639269730944:12345-0@lo:502: Request processed in 251us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.812561:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790656453.813028:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8014:1877639269730944:0@lo:502: 00000040:00080000:0.0:1790656453.813052:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790656453.813171:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790656453.813191:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790656453.813200:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.813212:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656453.813221:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790656453.813224:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790656453.813226:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790656453.813252:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.813260:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.813268:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656453.813281:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731072:0@lo:101: 00000100:00100000:3.0:1790656453.813313:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.813334:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.817778:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731072 00000100:00100000:1.0:1790656453.817809:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731072 00000100:00100000:1.0:1790656453.817865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790656453.817875:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269731072:12345-0@lo:101: 00010000:00010000:1.0:1790656453.817891:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656453.817910:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.817937:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.817948:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.817956:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce000, rc 0) 00000100:00100000:1.0:1790656453.818028:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731072:12345-0@lo:101: Request processed in 154us (4714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.818041:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790656453.818095:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731072:0@lo:101: 00010000:00010000:1.0:1790656453.818114:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.818123:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.818182:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731200:0@lo:501: 00000100:00100000:1.0:1790656453.818213:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.818240:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.818255:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731200 00000100:00100000:1.0:1790656453.818259:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731200 00000100:00100000:1.0:1790656453.818279:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790656453.818286:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731200:12345-0@lo:501: 00000100:00100000:1.0:1790656453.818543:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731200:12345-0@lo:501: Request processed in 248us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.818550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790656453.818579:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731200:0@lo:501: 00000100:00100000:1.0:1790656453.818625:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731328:0@lo:503: 00000100:00100000:1.0:1790656453.818672:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.818686:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.818698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731328 00000100:00100000:1.0:1790656453.818702:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731328 00000100:00100000:1.0:1790656453.818722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790656453.818728:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731328:12345-0@lo:503: 00000100:00100000:1.0:1790656453.819001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731328:12345-0@lo:503: Request processed in 272us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.819008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790656453.819046:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731328:0@lo:503: 00000100:00100000:1.0:1790656453.822266:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8017:1877639269731456:0@lo:502: 00000100:00100000:1.0:1790656453.822353:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.822406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731456 00000100:00100000:1.0:1790656453.822413:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731456 00000100:00100000:1.0:1790656453.822450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790656453.822456:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8017:x1877639269731456:12345-0@lo:502: 00000100:00100000:1.0:1790656453.822728:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8017:x1877639269731456:12345-0@lo:502: Request processed in 269us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.822735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790656453.822786:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.824871:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8017:1877639269731456:0@lo:502: 00000020:01000000:1.0:1790656453.824912:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656453.824923:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656453.824925:0:8017:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790656453.824930:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790656453.824931:0:8017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790656453.824958:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8017:1877639269731584:0@lo:502: 00000100:00100000:1.0:1790656453.825015:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.825054:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731584 00000100:00100000:1.0:1790656453.825061:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731584 00000100:00100000:1.0:1790656453.825097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790656453.825104:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8017:x1877639269731584:12345-0@lo:502: 00000100:00100000:1.0:1790656453.825291:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8017:x1877639269731584:12345-0@lo:502: Request processed in 187us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.825299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790656453.825356:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.825372:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8017:1877639269731584:0@lo:502: 00000020:01000000:1.0:1790656453.825388:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656453.825393:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656453.825394:0:8017:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790656453.825398:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790656453.825463:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790656453.825480:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790656453.825489:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.825500:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656453.825509:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790656453.825512:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943928721000 from 30 10000000:01000000:1.0:1790656453.825514:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790656453.832047:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.832064:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.832074:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.832097:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731712:0@lo:101: 00000100:00100000:1.0:1790656453.832175:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.832220:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656453.832292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731712 00000100:00100000:0.0:1790656453.832300:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731712 00000100:00100000:0.0:1790656453.832355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790656453.832365:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269731712:12345-0@lo:101: 00010000:00010000:0.0:1790656453.832378:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656453.832391:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa4f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656453.832413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656453.832423:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656453.832432:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030a00, rc 0) 00000100:00100000:0.0:1790656453.832475:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269731712:12345-0@lo:101: Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656453.832482:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790656453.833034:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731712:0@lo:101: 00010000:00010000:1.0:1790656453.833052:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.833062:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.833114:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731840:0@lo:501: 00000100:00100000:1.0:1790656453.833143:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.833174:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656453.833225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731840 00000100:00100000:0.0:1790656453.833231:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731840 00000100:00100000:0.0:1790656453.833265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790656453.833273:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269731840:12345-0@lo:501: 00000100:00100000:0.0:1790656453.833559:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269731840:12345-0@lo:501: Request processed in 286us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656453.833576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790656453.834710:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731840:0@lo:501: 00000100:00100000:1.0:1790656453.834754:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731968:0@lo:503: 00000100:00100000:1.0:1790656453.834913:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.834948:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656453.835045:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269731968 00000100:00100000:0.0:1790656453.835052:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269731968 00000100:00100000:0.0:1790656453.835083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790656453.835091:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269731968:12345-0@lo:503: 00000100:00100000:0.0:1790656453.835256:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269731968:12345-0@lo:503: Request processed in 165us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656453.835263:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790656453.835388:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269731968:0@lo:503: 00000100:00100000:1.0:1790656453.836137:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8018:1877639269732096:0@lo:502: 00000100:00100000:1.0:1790656453.836179:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.836210:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519000 going to sleep for 11 seconds 00000100:00100000:0.0:1790656453.836375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732096 00000100:00100000:0.0:1790656453.836380:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732096 00000100:00100000:0.0:1790656453.836414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790656453.836421:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8018:x1877639269732096:12345-0@lo:502: 00000100:00100000:0.0:1790656453.837005:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8018:x1877639269732096:12345-0@lo:502: Request processed in 581us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656453.837012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790656453.837098:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8018:1877639269732096:0@lo:502: 00000100:00100000:1.0:1790656453.837143:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8018:1877639269732224:0@lo:502: 00000100:00100000:1.0:1790656453.837181:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.837207:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519000 going to sleep for 11 seconds 00000100:00100000:0.0:1790656453.837255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732224 00000100:00100000:0.0:1790656453.837260:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732224 00000100:00100000:0.0:1790656453.837683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790656453.837692:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8018:x1877639269732224:12345-0@lo:502: 00000100:00100000:0.0:1790656453.837973:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8018:x1877639269732224:12345-0@lo:502: Request processed in 281us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656453.837980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790656453.838045:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8018:1877639269732224:0@lo:502: 00000040:00080000:2.0:1790656453.838069:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790656453.842073:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790656453.842141:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790656453.842153:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.842180:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656453.842191:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790656453.842194:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943928721000 from 5 10000000:01000000:3.0:1790656453.842197:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790656453.842238:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.842246:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.842257:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656453.842279:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732352:0@lo:101: 00000100:00100000:3.0:1790656453.842357:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.843440:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.844021:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732352 00000100:00100000:1.0:1790656453.844030:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732352 00000100:00100000:1.0:1790656453.844074:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790656453.844096:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269732352:12345-0@lo:101: 00010000:00010000:1.0:1790656453.844110:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656453.844125:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421ce200/0x9c3a6e82066eaa64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa5d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.844148:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421ce200/0x9c3a6e82066eaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa5d expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.844158:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421ce200/0x9c3a6e82066eaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa5d expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.844166:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce200, rc 0) 00000100:00100000:1.0:1790656453.844250:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269732352:12345-0@lo:101: Request processed in 158us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.844257:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790656453.847109:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732352:0@lo:101: 00010000:00010000:3.0:1790656453.847134:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.847147:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656453.847212:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732480:0@lo:256: 00000100:00100000:3.0:1790656453.847270:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.847318:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c2300 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.847349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732480 00000100:00100000:3.0:1790656453.847355:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732480 00000100:00100000:3.0:1790656453.847411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790656453.847419:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269732480:12345-0@lo:256: 20000000:01000000:3.0:1790656453.847438:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790656453.847452:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790656453.847456:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790656453.847773:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269732480:12345-0@lo:256: Request processed in 353us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.847780:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790656453.847892:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732480:0@lo:256: 10000000:01000000:3.0:1790656453.847931:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790656453.847938:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.847947:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656453.847955:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790656453.847958:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790656453.847960:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790656453.847982:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.847989:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656453.847998:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656453.848018:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732608:0@lo:101: 00000100:00100000:3.0:1790656453.848043:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.848069:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.848204:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732608 00000100:00100000:1.0:1790656453.848211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732608 00000100:00100000:1.0:1790656453.848237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790656453.848245:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269732608:12345-0@lo:101: 00010000:00010000:1.0:1790656453.848253:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656453.848267:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa6b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.848285:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.848295:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.848303:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf200, rc 0) 00000100:00100000:1.0:1790656453.848359:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269732608:12345-0@lo:101: Request processed in 114us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.848366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790656453.848407:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732608:0@lo:101: 00010000:00010000:1.0:1790656453.848418:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.848426:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.848470:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732736:0@lo:501: 00000100:00100000:1.0:1790656453.848494:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.848513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732736 00000100:00100000:1.0:1790656453.848529:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732736 00000100:00100000:1.0:1790656453.848554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790656453.848560:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269732736:12345-0@lo:501: 00000100:00100000:1.0:1790656453.848973:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269732736:12345-0@lo:501: Request processed in 412us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.848980:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790656453.849001:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.849011:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732736:0@lo:501: 00000100:00100000:1.0:1790656453.849035:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732864:0@lo:503: 00000100:00100000:1.0:1790656453.849069:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.849081:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903229240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.849092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732864 00000100:00100000:1.0:1790656453.849096:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732864 00000100:00100000:1.0:1790656453.849111:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790656453.849121:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269732864:12345-0@lo:503: 00000100:00100000:1.0:1790656453.849402:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269732864:12345-0@lo:503: Request processed in 280us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.849408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790656453.849447:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269732864:0@lo:503: 00000100:00100000:3.0:1790656453.853490:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8020:1877639269732992:0@lo:502: 00000100:00100000:3.0:1790656453.853861:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.853935:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bce3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.859269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269732992 00000100:00100000:1.0:1790656453.859284:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269732992 00000100:00100000:1.0:1790656453.859352:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790656453.859362:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8020:x1877639269732992:12345-0@lo:502: 00000100:00100000:1.0:1790656453.859931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8020:x1877639269732992:12345-0@lo:502: Request processed in 569us (6070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.859940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790656453.860826:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8020:1877639269732992:0@lo:502: 00000020:01000000:2.0:1790656453.860863:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790656453.860870:0:8020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790656453.860878:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656453.860880:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790656453.860886:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790656453.860890:0:8020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1790656453.860910:0:8020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790656453.860913:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790656453.860928:0:8020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94393c89cd40) 00000020:00000080:2.0:1790656453.860948:0:8020:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790656453.860954:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790656453.861032:0:8020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790656453.861038:0:8020:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790656453.861055:0:8020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066eaa80 00010000:00080000:2.0:1790656453.861082:0:8020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94392dadc800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1790656453.861291:0:8020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790656453.862077:0:8020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790656453.862091:0:8020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790656453.869140:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656453.869479:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656453.869561:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790656453.871410:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790656453.872108:0:8022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790656453.872113:0:8022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790656453.872771:0:8020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790656453.872782:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790656453.872813:0:8020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790656453.872835:0:8020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066eaa87 00000100:00080000:2.0:1790656453.872845:0:8020:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790656453.872855:0:8020:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94392dadc800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656453.872889:0:8020:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bfa0700 x1877639269733120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656453.872911:0:8020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790656453.872960:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656453.872965:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656453.872967:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790656453.872970:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656453.872973:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656453.872975:0:8020:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790656453.872977:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790656453.872979:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790656453.873006:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8020:1877639269733248:0@lo:502: 00000100:00100000:2.0:1790656453.873075:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.873114:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff943935148600 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.873385:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733248 00000100:00100000:3.0:1790656453.873391:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733248 00000100:00100000:3.0:1790656453.873427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790656453.873436:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8020:x1877639269733248:12345-0@lo:502: 00000100:00100000:3.0:1790656453.873685:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8020:x1877639269733248:12345-0@lo:502: Request processed in 249us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.873692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790656453.873735:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269733504:0@lo:400: 00000100:00100000:3.0:1790656453.873765:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.873789:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656453.873795:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269733632:0@lo:400: 00000100:00100000:3.0:1790656453.873818:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.873847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733504 00000100:00100000:3.0:1790656453.873851:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733504 00000100:00100000:3.0:1790656453.873879:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656453.873885:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269733504:12345-0@lo:400: 00000100:00100000:3.0:1790656453.873920:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269733504:12345-0@lo:400: Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.873927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656453.873950:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733632 00000100:00100000:3.0:1790656453.873954:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733632 00000100:00100000:3.0:1790656453.873973:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656453.873979:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269733632:12345-0@lo:400: 00000100:00100000:3.0:1790656453.874006:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269733632:12345-0@lo:400: Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.874011:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790656453.874042:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935113100 x1877639269733632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.874054:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269733632:0@lo:400: 00010000:00080000:3.0:1790656453.874063:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935111f80 x1877639269733504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.874071:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269733504:0@lo:400: 00000100:00100000:2.0:1790656453.874195:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269733376:0@lo:400: 00000100:00100000:2.0:1790656453.874226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.874256:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656453.874262:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269733760:0@lo:400: 00000100:00100000:2.0:1790656453.874298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.874332:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8020:1877639269733248:0@lo:502: 00000020:01000000:2.0:1790656453.874367:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656453.874374:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656453.874375:0:8020:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790656453.874380:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1790656453.874527:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269733120:0@lo:8: 00000100:00100000:1.0:1790656453.874558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1790656453.874621:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1790656453.874653:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790656453.874663:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874673:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656453.874683:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790656453.874685:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94390a368000 from 1 10000000:01000000:1.0:1790656453.874688:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790656453.874710:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874729:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874738:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.874752:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269733888:0@lo:101: 00000100:00100000:1.0:1790656453.874784:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.874800:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903229240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.874816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733888 00000100:00100000:1.0:1790656453.874820:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733888 00000100:00100000:1.0:1790656453.874848:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790656453.874854:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269733888:12345-0@lo:101: 00010000:00010000:1.0:1790656453.874863:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656453.874873:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874894:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874904:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.874911:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cfe00, rc 0) 00000100:00100000:1.0:1790656453.874940:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269733888:12345-0@lo:101: Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.874947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790656453.874980:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269733888:0@lo:101: 00010000:00010000:1.0:1790656453.874998:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.875006:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656453.875043:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269734016:0@lo:501: 00000100:00100000:1.0:1790656453.875067:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.875081:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790656453.875093:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734016 00000100:00100000:1.0:1790656453.875096:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734016 00000100:00100000:1.0:1790656453.875118:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790656453.875124:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269734016:12345-0@lo:501: 00000100:00100000:1.0:1790656453.875318:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269734016:12345-0@lo:501: Request processed in 193us (249us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656453.875325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790656453.875364:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269734016:0@lo:501: 10000000:01000000:1.0:1790656453.875381:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790656453.875386:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656453.875393:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656453.875525:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733120 00000100:00100000:2.0:1790656453.875529:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733120 00000100:00100000:2.0:1790656453.875551:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656453.875556:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1877639269733120:12345-0@lo:8: 00010000:00080000:2.0:1790656453.875577:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1790656453.875619:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066eaa9c 00002000:00100000:2.0:1790656453.875631:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94392dadf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1790656453.875717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733376 00000100:00100000:3.0:1790656453.875722:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733376 00000100:00100000:3.0:1790656453.875745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269733760 00000100:00100000:3.0:1790656453.875747:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269733760 00000100:00100000:3.0:1790656453.875761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656453.875766:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269733376:12345-0@lo:400: 00000100:00100000:3.0:1790656453.875804:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269733376:12345-0@lo:400: Request processed in 37us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.875809:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656453.875821:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790656453.875827:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269733760:12345-0@lo:400: 00000100:00100000:3.0:1790656453.875852:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269733760:12345-0@lo:400: Request processed in 26us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656453.875870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790656453.875904:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935113800 x1877639269733760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.875915:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269733760:0@lo:400: 00010000:00080000:3.0:1790656453.875925:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935112300 x1877639269733376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.875933:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269733376:0@lo:400: 00002000:00080000:2.0:1790656453.875972:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1790656453.875976:0:6692:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790656453.876064:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790656453.876204:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790656453.876227:0:6692:0:(import.c:65:import_set_state_nolock()) ffff94392dad9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656453.876270:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1877639269733120:12345-0@lo:8: Request processed in 713us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656453.876277:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790656453.876529:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bfa0700 x1877639269733120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790656463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.876539:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790656453.876547:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790656453.876554:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790656453.876558:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790656453.876561:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94392dadc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790656453.876583:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790656453.876607:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269733120:0@lo:8: 00000004:00080000:1.0:1790656453.876737:0:8022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790656453.876825:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 169013232678ns, next at 0ns, rc = 0 00000004:00080000:0.0:1790656453.903964:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790656453.904109:0:8023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790656453.904135:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734272:0@lo:7: 00000100:00100000:3.0:1790656453.904197:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.904233:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656453.904265:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734272 00000100:00100000:2.0:1790656453.904285:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734272 00000100:00080000:3.0:1790656453.904346:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656453.904357:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656453.904367:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877639269734272:12345-0@lo:7: 00000100:00100000:0.0:1790656453.905636:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269734144:0@lo:13: 00000100:00100000:0.0:1790656453.905683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656453.905912:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734144 00000100:00100000:1.0:1790656453.905928:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734144 00000100:00100000:1.0:1790656453.905977:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790656453.905985:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1877639269734144:12345-0@lo:13: 00002000:00000024:1.0:1790656453.906009:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790656453.906053:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1877639269734144:12345-0@lo:13: Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.906060:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790656453.906189:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935112300 x1877639269734144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656453.906215:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269734144:0@lo:13: 00002000:00080000:1.0:1790656453.919909:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1790656453.919918:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790656453.920129:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877639269734272:12345-0@lo:7: Request processed in 15760us (15927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656453.920142:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790656453.920211:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935113800 x1877639269734272/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790656469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.920226:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734272:0@lo:7: 00000004:00080000:3.0:1790656453.920249:0:8023:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790656453.920316:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734400:0@lo:5: 00000100:00100000:2.0:1790656453.920368:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656453.920413:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff943935148cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.920703:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734400 00000100:00100000:3.0:1790656453.920711:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734400 00000100:00100000:0.0:1790656453.923680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656453.923697:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8023:x1877639269734400:12345-0@lo:5: 00002000:00080000:0.0:1790656453.923728:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790656453.923733:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790656453.924195:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8023:x1877639269734400:12345-0@lo:5: Request processed in 503us (3826us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790656453.924204:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790656453.924278:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bfa2300 x1877639269734400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790656469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656453.924296:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734400:0@lo:5: 00000004:00080000:3.0:1790656453.924308:0:8023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790656453.924352:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734528:0@lo:700: 00000100:00100000:3.0:1790656453.924386:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.924414:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.924431:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734528 00000100:00100000:3.0:1790656453.924437:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734528 00000100:00100000:3.0:1790656453.924468:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790656453.924474:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8023:x1877639269734528:12345-0@lo:700: 00000100:00100000:3.0:1790656453.924500:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935110380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1877639269734656:0@lo:700: 00000100:00100000:3.0:1790656453.924526:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656453.924541:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656453.924557:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734656 00000100:00100000:3.0:1790656453.924560:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734656 00000100:00100000:3.0:1790656453.924585:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790656453.924613:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1877639269734656:12345-0@lo:700: 40000000:02000000:3.0:1790656454.001912:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1790656454.015950:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1877639269734656:12345-0@lo:700: Request processed in 91351us (91416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656454.015964:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790656454.016451:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935110380 x1877639269734656/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790656469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656454.016534:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935110380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1877639269734656:0@lo:700: 40000000:02000000:0.0:1790656454.016548:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1790656454.106536:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8023:x1877639269734528:12345-0@lo:700: Request processed in 182052us (182140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656454.106555:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1790656454.106609:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1790656454.106626:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1790656454.106948:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935113800 x1877639269734528/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790656469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656454.106965:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734528:0@lo:700: 00000004:02000040:2.0:1790656454.151654:0:8023:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1790656454.156085:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734784:0@lo:5: 00000100:00100000:2.0:1790656454.156168:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656454.156215:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656454.156295:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734784 00000100:00100000:1.0:1790656454.156304:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734784 00000100:00100000:1.0:1790656454.156364:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790656454.156376:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8023:x1877639269734784:12345-0@lo:5: 00002000:00080000:2.0:1790656454.168206:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790656454.168226:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790656454.183006:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877639269734784:12345-0@lo:5: Request processed in 26627us (26831us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790656454.183016:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790656454.183105:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bfa2d80 x1877639269734784/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790656470 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656454.183119:0:8023:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790656454.183146:0:8023:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94393bfa2d80 x1877639269734784/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790656470 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656454.183157:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877639269734784:0@lo:5: 00000004:00080000:2.0:1790656454.183169:0:8023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1790656454.369890:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656455.327100:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269734912:0@lo:13: 00000100:00100000:3.0:1790656455.327164:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656455.327291:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269734912 00000100:00100000:1.0:1790656455.327299:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269734912 00000100:00100000:1.0:1790656455.327366:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790656455.327376:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269734912:12345-0@lo:13: 00002000:00000024:1.0:1790656455.327418:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656455.327464:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269734912:12345-0@lo:13: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656455.327486:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1790656455.327556:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790656455.327583:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47d180 x1877639269734912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656455.327622:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269734912:0@lo:13: 00010000:00010000:0.0:1790656455.391940:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656456.419527:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656457.439841:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790656457.653337:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790656458.186372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656458.186654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248740480 00000100:00100000:3.0:1790656458.186663:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248740480 00000100:00100000:3.0:1790656458.186700:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1790656458.186709:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2338:x1877639248740480:12345-192.168.203.23@tcp:250: 00010000:00080000:3.0:1790656458.186736:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ce46cfe8-c882-4ab6-90c2-4205ad1ab4df@192.168.203.23@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1790656458.186764:0:5837:0:(genops.c:1384:class_connect()) connect: client ce46cfe8-c882-4ab6-90c2-4205ad1ab4df, cookie 0x9c3a6e82066eaaa3 00000100:00080000:3.0:1790656458.186913:0:5837:0:(import.c:65:import_set_state_nolock()) ffff94391f586800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656458.186983:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+5:2338:x1877639248740480:12345-192.168.203.23@tcp:250: Request processed in 273us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.186991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:2.0:1790656458.210127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656458.214868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248740608 00000100:00100000:1.0:1790656458.214884:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248740608 00000100:00100000:1.0:1790656458.218871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:1.0:1790656458.218895:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+5:5569:x1877639248740608:12345-192.168.203.23@tcp:101: 00010000:00010000:1.0:1790656458.218913:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656458.218932:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2375cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.218962:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.218974:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.218982:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c800, rc 0) 00000100:00100000:1.0:1790656458.219051:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+6:5569:x1877639248740608:12345-192.168.203.23@tcp:101: Request processed in 168us (8933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656458.219059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:0.0:1790656458.228087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656458.228560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248740736 00000100:00100000:2.0:1790656458.228571:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248740736 00000100:00100000:2.0:1790656458.228659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:2.0:1790656458.228668:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+6:5569:x1877639248740736:12345-192.168.203.23@tcp:501: 00000100:00100000:2.0:1790656458.228998:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+6:5569:x1877639248740736:12345-192.168.203.23@tcp:501: Request processed in 330us (931us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790656458.229007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:0.0:1790656458.231761:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656458.231870:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248740864 00000100:00100000:1.0:1790656458.231880:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248740864 00000100:00100000:1.0:1790656458.231937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1790656458.231948:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+6:5569:x1877639248740864:12345-192.168.203.23@tcp:101: 00010000:00010000:1.0:1790656458.231964:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656458.231986:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2375d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.232024:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.232035:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656458.232044:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c200, rc 0) 00000100:00100000:1.0:1790656458.232095:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+7:5569:x1877639248740864:12345-192.168.203.23@tcp:101: Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656458.232104:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:0.0:1790656458.237060:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656458.237232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248740992 00000100:00100000:3.0:1790656458.237241:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248740992 00000100:00100000:3.0:1790656458.237298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:3.0:1790656458.237322:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+7:5569:x1877639248740992:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1790656458.237629:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5569:x1877639248740992:12345-192.168.203.23@tcp:501: Request processed in 321us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.237646:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1790656458.239203:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656458.239265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741120 00000100:00100000:1.0:1790656458.239271:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741120 00000100:00100000:1.0:1790656458.239315:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1790656458.239324:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5569:x1877639248741120:12345-192.168.203.23@tcp:503: 00000100:00100000:1.0:1790656458.239527:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5569:x1877639248741120:12345-192.168.203.23@tcp:503: Request processed in 204us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656458.239532:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1790656458.241201:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656458.241373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741248 00000100:00100000:3.0:1790656458.241381:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741248 00000100:00100000:3.0:1790656458.241420:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:3.0:1790656458.241430:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5587:x1877639248741248:12345-192.168.203.23@tcp:502: 00000100:00100000:3.0:1790656458.241743:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5587:x1877639248741248:12345-192.168.203.23@tcp:502: Request processed in 314us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.241751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:0.0:1790656458.277831:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656458.277911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741376 00000100:00100000:1.0:1790656458.277920:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741376 00000100:00100000:1.0:1790656458.277969:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:1.0:1790656458.277980:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5587:x1877639248741376:12345-192.168.203.23@tcp:502: 00000100:00100000:1.0:1790656458.278286:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5587:x1877639248741376:12345-192.168.203.23@tcp:502: Request processed in 307us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656458.278294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:1.0:1790656458.280435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656458.280615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741504 00000100:00100000:2.0:1790656458.280624:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741504 00000100:00100000:2.0:1790656458.280719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:2.0:1790656458.280731:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5569:x1877639248741504:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1790656458.280746:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656458.280764:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013fe400/0x9c3a6e82066eaab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2375fd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.280792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013fe400/0x9c3a6e82066eaab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375fd expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.280803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013fe400/0x9c3a6e82066eaab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375fd expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.280813:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013fe400, rc 0) 00000100:00100000:2.0:1790656458.280860:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5569:x1877639248741504:12345-192.168.203.23@tcp:101: Request processed in 131us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656458.280867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:0.0:1790656458.284953:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656458.285007:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741632 00000100:00100000:2.0:1790656458.285017:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741632 00000100:00100000:2.0:1790656458.285426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:2.0:1790656458.285436:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5569:x1877639248741632:12345-192.168.203.23@tcp:256: 20000000:01000000:2.0:1790656458.285470:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790656458.285486:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790656458.285490:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790656458.285493:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790656458.285496:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790656458.288343:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5569:x1877639248741632:12345-192.168.203.23@tcp:256: Request processed in 2899us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.288356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:3.0:1790656458.292064:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656458.292261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741760 00000100:00100000:2.0:1790656458.292271:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741760 00000100:00100000:2.0:1790656458.292330:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1790656458.292339:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5569:x1877639248741760:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1790656458.292355:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656458.292372:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237604 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.292400:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.292411:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656458.292419:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439013ff400, rc 0) 00000100:00100000:2.0:1790656458.292482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5569:x1877639248741760:12345-192.168.203.23@tcp:101: Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656458.292489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:0.0:1790656458.296296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656458.296764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248741888 00000100:00100000:3.0:1790656458.296776:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248741888 00000100:00100000:3.0:1790656458.296874:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:3.0:1790656458.296886:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5569:x1877639248741888:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1790656458.297381:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5569:x1877639248741888:12345-192.168.203.23@tcp:501: Request processed in 498us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.297390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:3.0:1790656458.305953:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656458.306008:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742016 00000100:00100000:0.0:1790656458.306018:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742016 00000100:00100000:0.0:1790656458.306070:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:0.0:1790656458.306080:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5569:x1877639248742016:12345-192.168.203.23@tcp:503: 00000100:00100000:0.0:1790656458.306446:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5569:x1877639248742016:12345-192.168.203.23@tcp:503: Request processed in 367us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.306455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:1.0:1790656458.312575:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656458.316283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742144 00000100:00100000:2.0:1790656458.316315:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742144 00000100:00100000:2.0:1790656458.316397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1790656458.316410:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5592:x1877639248742144:12345-192.168.203.23@tcp:502: 00000100:00100000:2.0:1790656458.316777:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5592:x1877639248742144:12345-192.168.203.23@tcp:502: Request processed in 369us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656458.316793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1790656458.325753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656458.327753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742272 00000100:00100000:0.0:1790656458.327767:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742272 00000100:00100000:0.0:1790656458.327890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:0.0:1790656458.327900:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5592:x1877639248742272:12345-192.168.203.23@tcp:502: 00000100:00100000:0.0:1790656458.328337:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5592:x1877639248742272:12345-192.168.203.23@tcp:502: Request processed in 437us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.328345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:2.0:1790656458.333098:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656458.333545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742400 00000100:00100000:0.0:1790656458.333557:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742400 00000100:00100000:0.0:1790656458.333626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1790656458.333635:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2338:x1877639248742400:12345-192.168.203.23@tcp:38: 00010000:00080000:0.0:1790656458.333664:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1790656458.333726:0:5843:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eaac6 00000004:00100000:0.0:1790656458.333755:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790656458.333762:0:5843:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790656458.375422:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9439353a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656458.375811:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248742400:12345-192.168.203.23@tcp:38: Request processed in 42172us (42720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.375824:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00010000:00010000:0.0:1790656458.463434:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656458.911501:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269735040:0@lo:400: 00000100:00100000:3.0:1790656458.911623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656458.911690:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269735552:0@lo:400: 00000100:00100000:3.0:1790656458.911720:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656458.911755:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790656458.911770:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269735424:0@lo:400: 00000100:00100000:3.0:1790656458.911797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656458.911830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735552 00000100:00100000:3.0:1790656458.911841:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735552 00000100:00100000:3.0:1790656458.911908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790656458.911920:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269735552:12345-0@lo:400: 00000100:00100000:3.0:1790656458.911982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269735552:12345-0@lo:400: Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656458.911989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790656458.912013:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790656458.912045:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a45880 x1877639269735552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656458.912060:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269735552:0@lo:400: 00000100:00100000:2.0:1790656458.912144:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735040 00000100:00100000:2.0:1790656458.912149:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735040 00000100:00100000:2.0:1790656458.912191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790656458.912199:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269735040:12345-0@lo:400: 00000100:00100000:2.0:1790656458.912236:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269735040:12345-0@lo:400: Request processed in 38us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656458.912241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790656458.912457:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269735296:0@lo:400: 00000100:00100000:0.0:1790656458.912496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656458.912548:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790656458.912556:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269735168:0@lo:400: 00000100:00100000:0.0:1790656458.912578:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656458.912618:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269735680:0@lo:400: 00000100:00100000:0.0:1790656458.912643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656458.912676:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735424 00000100:00100000:0.0:1790656458.912680:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735424 00000100:00100000:0.0:1790656458.912715:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735680 00000100:00100000:0.0:1790656458.912719:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735680 00000100:00100000:0.0:1790656458.912735:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656458.912742:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269735424:12345-0@lo:400: 00000100:00100000:0.0:1790656458.912778:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269735424:12345-0@lo:400: Request processed in 37us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.912785:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656458.912798:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656458.912805:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269735680:12345-0@lo:400: 00000100:00100000:0.0:1790656458.912838:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269735680:12345-0@lo:400: Request processed in 34us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.912844:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656458.912876:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735296 00000100:00100000:0.0:1790656458.912879:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735296 00000100:00100000:0.0:1790656458.912902:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735168 00000100:00100000:0.0:1790656458.912905:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735168 00000100:00100000:0.0:1790656458.912916:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656458.912922:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269735296:12345-0@lo:400: 00000100:00100000:0.0:1790656458.912952:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269735296:12345-0@lo:400: Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.912958:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656458.912978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790656458.912984:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269735168:12345-0@lo:400: 00000100:00100000:0.0:1790656458.913015:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269735168:12345-0@lo:400: Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656458.913021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1790656458.913047:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790656458.913051:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656458.913054:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790656458.913078:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a45180 x1877639269735168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656458.913091:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269735168:0@lo:400: 00010000:00080000:0.0:1790656458.913102:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a44a80 x1877639269735680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656458.913108:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790656458.913123:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269735680:0@lo:400: 00010000:00080000:0.0:1790656458.913134:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47100 x1877639269735296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656458.913141:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269735296:0@lo:400: 00010000:00080000:3.0:1790656458.913402:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47800 x1877639269735424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656458.913413:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269735424:0@lo:400: 00000100:00100000:3.0:1790656458.913424:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269735040:0@lo:400: 00000100:00100000:0.0:1790656458.915011:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269735808:0@lo:13: 00000100:00100000:0.0:1790656458.915170:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656458.915587:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735808 00000100:00100000:2.0:1790656458.915633:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735808 00000100:00100000:2.0:1790656458.915699:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790656458.915710:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269735808:12345-0@lo:13: 00002000:00000024:2.0:1790656458.915755:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656458.915832:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269735808:12345-0@lo:13: Request processed in 120us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656458.915840:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790656458.916087:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a44700 x1877639269735808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656458.916110:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269735808:0@lo:13: 00000100:00100000:2.0:1790656459.387816:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656459.387907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742656 00000100:00100000:0.0:1790656459.387920:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742656 00000100:00100000:0.0:1790656459.388019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1790656459.388032:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248742656:12345-192.168.203.23@tcp:41: 00000004:00000024:0.0:1790656459.388089:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790656459.388204:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248742656:12345-192.168.203.23@tcp:41: Request processed in 173us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656459.388212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00080000:3.0:1790656459.388346:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656459.390293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656459.390814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742528 00000100:00100000:0.0:1790656459.390827:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742528 00000100:00100000:0.0:1790656459.390903:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1790656459.390915:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:0:x1877639248742528:12345-192.168.203.23@tcp:41: 00000004:00000024:0.0:1790656459.390956:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790656459.391054:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:0:x1877639248742528:12345-192.168.203.23@tcp:41: Request processed in 141us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656459.391061:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1790656459.396444:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656459.396871:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742784 00000100:00100000:0.0:1790656459.396886:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742784 00000100:00100000:0.0:1790656459.396959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1790656459.396970:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248742784:12345-192.168.203.23@tcp:40: 00000100:00100000:0.0:1790656459.397158:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248742784:12345-192.168.203.23@tcp:40: Request processed in 189us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656459.397167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656459.417067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656459.417128:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656459.417253:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656459.417322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656459.417795:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248742912 00000100:00100000:3.0:1790656459.417808:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248742912 00000100:00100000:3.0:1790656459.417869:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743040 00000100:00100000:3.0:1790656459.417874:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743040 00000100:00100000:3.0:1790656459.417891:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1790656459.417901:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2338:x1877639248742912:12345-192.168.203.23@tcp:8: 00010000:00080000:3.0:1790656459.417946:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1790656459.417994:0:6692:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eaacd 00002000:00100000:3.0:1790656459.418026:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 177b5748-b800-471f-9375-621ebde8193b/ffff94391f587000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790656459.418057:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1790656459.419923:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743296 00000100:00100000:0.0:1790656459.419941:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743296 00000100:00100000:0.0:1790656459.420026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:0.0:1790656459.420039:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2341:x1877639248743296:12345-192.168.203.23@tcp:400: 00000100:00100000:0.0:1790656459.420144:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2341:x1877639248743296:12345-192.168.203.23@tcp:400: Request processed in 107us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656459.420153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1790656459.420436:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743168 00000100:00100000:1.0:1790656459.420445:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743168 00000100:00100000:1.0:1790656459.420508:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1790656459.420520:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248743168:12345-192.168.203.23@tcp:33: 00002000:00080000:3.0:1790656459.424561:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790656459.424643:0:6692:0:(import.c:65:import_set_state_nolock()) ffff94391f582800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656459.424749:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248742912:12345-192.168.203.23@tcp:8: Request processed in 6841us (7691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656459.424762:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1790656459.424808:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1790656459.424816:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2338:x1877639248743040:12345-192.168.203.23@tcp:8: 00010000:00080000:3.0:1790656459.424849:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1790656459.424886:0:6692:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eaad4 00002000:00100000:3.0:1790656459.424903:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 177b5748-b800-471f-9375-621ebde8193b/ffff94391f586000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790656459.424915:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790656459.425285:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790656459.425320:0:6692:0:(import.c:65:import_set_state_nolock()) ffff94391f583800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656459.425357:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248743040:12345-192.168.203.23@tcp:8: Request processed in 540us (8103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656459.425364:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000004:00080000:3.0:1790656459.476444:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 55218us 00010000:00010000:0.0:1790656459.487546:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1790656459.513873:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790656459.514048:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+6:5569:x1877639248743168:12345-192.168.203.23@tcp:33: Request processed in 93524us (96910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656459.514067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656459.757918:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656459.759029:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743424 00000100:00100000:2.0:1790656459.759049:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743424 00000100:00100000:2.0:1790656459.759154:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1790656459.759170:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:5609:x1877639248743424:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1790656459.759223:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656459.759696:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439013ff000/0x9c3a6e82066eaadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23762e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.759931:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.759945:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.759960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656459.759994:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656459.759998:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656459.760014:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.760041:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439013ff000/0x9c3a6e82066eaadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23762e expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.760061:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23762e expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656459.760069:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4ac00) 00010000:00010000:2.0:1790656459.760072:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656459.760076:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656459.760152:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+7:5609:x1877639248743424:12345-192.168.203.23@tcp:101: Request processed in 987us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656459.760161:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1790656460.451851:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790656460.451888:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269735936:0@lo:13: 00000100:00100000:3.0:1790656460.452008:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656460.452276:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269735936 00000100:00100000:2.0:1790656460.452298:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269735936 00000100:00100000:2.0:1790656460.452382:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656460.452395:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269735936:12345-0@lo:13: 00002000:00000024:2.0:1790656460.452426:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656460.452495:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269735936:12345-0@lo:13: Request processed in 103us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656460.452502:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790656460.452643:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47f800 x1877639269735936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656460.452668:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269735936:0@lo:13: 00000100:00080000:3.0:1790656460.452827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790656460.510912:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656461.535572:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656461.872683:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656461.872796:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743552 00000100:00100000:0.0:1790656461.872814:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743552 00000100:00100000:0.0:1790656461.872912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1790656461.872923:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+7:5662:x1877639248743552:12345-192.168.203.23@tcp:41: 00000004:00000024:0.0:1790656461.872966:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790656461.873042:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+7:5662:x1877639248743552:12345-192.168.203.23@tcp:41: Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656461.873050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:3.0:1790656461.873365:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656461.878720:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656461.878890:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743680 00000100:00100000:2.0:1790656461.878900:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743680 00000100:00100000:2.0:1790656461.878970:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1790656461.878979:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:177b5748-b800-471f-9375-621ebde8193b+6:5662:x1877639248743680:12345-192.168.203.23@tcp:13: 00002000:00000024:2.0:1790656461.879013:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656461.879078:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:177b5748-b800-471f-9375-621ebde8193b+6:5662:x1877639248743680:12345-192.168.203.23@tcp:13: Request processed in 100us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656461.879085:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00080000:3.0:1790656461.879099:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656461.883989:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656461.884114:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743808 00000100:00100000:0.0:1790656461.884130:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743808 00000100:00100000:0.0:1790656461.884442:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1790656461.884455:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:177b5748-b800-471f-9375-621ebde8193b+6:5662:x1877639248743808:12345-192.168.203.23@tcp:13: 00002000:00000024:0.0:1790656461.884500:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656461.884714:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:177b5748-b800-471f-9375-621ebde8193b+6:5662:x1877639248743808:12345-192.168.203.23@tcp:13: Request processed in 260us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656461.884722:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:3.0:1790656461.884788:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1790656462.069454:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00010000:00010000:0.0:1790656462.559149:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656463.590881:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790656463.623752:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000001:00100000:0.0:1790656463.644171:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000100:00100000:2.0:1790656464.030709:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656464.030735:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269736448:0@lo:400: 00000100:00100000:1.0:1790656464.030748:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269736192:0@lo:400: 00000100:00100000:3.0:1790656464.030838:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269736576:0@lo:400: 00000100:00100000:2.0:1790656464.033382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656464.033452:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656464.033459:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269736064:0@lo:13: 00000100:00100000:2.0:1790656464.033500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656464.033552:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736448 00000100:00100000:2.0:1790656464.033560:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736448 00000100:00100000:1.0:1790656464.033578:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656464.033648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790656464.033658:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269736448:12345-0@lo:400: 00000100:00080000:3.0:1790656464.033739:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656464.033826:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736192 00000100:00100000:3.0:1790656464.033831:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736192 00000100:00100000:3.0:1790656464.033872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790656464.033881:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269736192:12345-0@lo:400: 00000100:00100000:3.0:1790656464.034014:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269736192:12345-0@lo:400: Request processed in 135us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656464.034019:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269736448:12345-0@lo:400: Request processed in 360us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656464.034025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790656464.034038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790656464.034069:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736576 00000100:00100000:2.0:1790656464.034073:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736576 00000100:00100000:2.0:1790656464.034118:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790656464.034128:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269736192:0@lo:400: 00000100:00100000:2.0:1790656464.034129:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269736576:12345-0@lo:400: 00000100:00100000:1.0:1790656464.034145:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269736704:0@lo:400: 00000100:00100000:2.0:1790656464.034182:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269736576:12345-0@lo:400: Request processed in 55us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656464.034190:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790656464.034196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656464.034213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736064 00000100:00100000:2.0:1790656464.034218:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736064 00000100:00100000:1.0:1790656464.034235:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790656464.034244:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269736320:0@lo:400: 00000100:00100000:2.0:1790656464.034251:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656464.034260:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269736064:12345-0@lo:13: 00000100:00100000:1.0:1790656464.034283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1790656464.034302:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656464.034313:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269736832:0@lo:400: 00000100:00100000:2.0:1790656464.034345:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269736064:12345-0@lo:13: Request processed in 87us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.034348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656464.034357:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656464.034380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736704 00000100:00100000:2.0:1790656464.034385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736704 00000100:00100000:2.0:1790656464.034410:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736320 00000100:00100000:2.0:1790656464.034418:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736320 00000100:00080000:3.0:1790656464.034453:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656464.034458:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656464.034460:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656464.034527:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656464.034536:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269736704:12345-0@lo:400: 00000100:00100000:1.0:1790656464.034660:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269736704:12345-0@lo:400: Request processed in 125us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.034666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656464.034688:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736832 00000100:00100000:1.0:1790656464.034693:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736832 00000100:00100000:1.0:1790656464.034718:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790656464.034726:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269736832:12345-0@lo:400: 00000100:00100000:1.0:1790656464.034769:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269736832:12345-0@lo:400: Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.034774:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790656464.034873:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269736704:0@lo:400: 00010000:00080000:3.0:1790656464.034890:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47fb80 x1877639269736832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656464.034900:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269736832:0@lo:400: 00000100:00100000:1.0:1790656464.035699:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269736448:0@lo:400: 00010000:00080000:1.0:1790656464.035710:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a45c00 x1877639269736064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656464.035724:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269736064:0@lo:13: 00000100:00100000:2.0:1790656464.035761:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790656464.035763:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47df80 x1877639269736576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656464.035772:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269736576:0@lo:400: 00000100:00100000:2.0:1790656464.035776:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269736320:12345-0@lo:400: 00000100:00100000:2.0:1790656464.035836:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269736320:12345-0@lo:400: Request processed in 64us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.035842:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269736320:0@lo:400: 00000100:00100000:2.0:1790656464.035847:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000001:02000400:2.0:1790656464.225220:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790656464.606762:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656464.648829:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656464.648866:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656464.648896:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656464.648946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656464.648976:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744192 00000100:00100000:1.0:1790656464.648985:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744192 00000100:00100000:1.0:1790656464.649048:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744320 00000100:00100000:1.0:1790656464.649051:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744320 00000100:00100000:1.0:1790656464.649069:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1790656464.649085:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248744192:12345-192.168.203.23@tcp:400: 00000100:00100000:1.0:1790656464.649156:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248744192:12345-192.168.203.23@tcp:400: Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.649164:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1790656464.649180:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1790656464.649186:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248744320:12345-192.168.203.23@tcp:400: 00000100:00100000:1.0:1790656464.649210:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248744320:12345-192.168.203.23@tcp:400: Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656464.649215:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:1.0:1790656464.649320:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656464.649324:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656464.649580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744064 00000100:00100000:0.0:1790656464.649585:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744064 00000100:00080000:1.0:1790656464.649632:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656464.649645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1790656464.649653:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248744064:12345-192.168.203.23@tcp:400: 00000100:00100000:0.0:1790656464.649717:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248744064:12345-192.168.203.23@tcp:400: Request processed in 57us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656464.649724:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1790656464.649882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248743936 00000100:00100000:2.0:1790656464.649894:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248743936 00000100:00100000:2.0:1790656464.649931:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:2.0:1790656464.649938:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248743936:12345-192.168.203.23@tcp:400: 00000100:00100000:2.0:1790656464.649979:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248743936:12345-192.168.203.23@tcp:400: Request processed in 41us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656464.649985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:3.0:1790656465.576129:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269736960:0@lo:13: 00000100:00100000:3.0:1790656465.576237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656465.576391:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269736960 00000100:00100000:1.0:1790656465.576402:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269736960 00000100:00100000:1.0:1790656465.576479:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790656465.576491:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269736960:12345-0@lo:13: 00002000:00000024:1.0:1790656465.576544:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656465.576743:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269736960:12345-0@lo:13: Request processed in 252us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656465.576750:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790656465.576842:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bd3d180 x1877639269736960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656465.576900:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269736960:0@lo:13: 00010000:00010000:1.0:1790656465.630899:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656466.656092:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656467.680339:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790656468.306132:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeb6cdab0 20000000:00000080:0.0:1790656468.306150:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94393b972800 uarg=0000000000000000 20000000:01000000:0.0:1790656468.306186:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790656468.306189:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790656468.306191:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790656468.306195:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790656468.306201:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790656468.306215:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790656468.306217:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790656468.306499:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790656468.306503:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790656468.314772:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790656468.315362:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790656468.315416:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790656468.315474:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1790656468.315488:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790656468.315491:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790656468.317117:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790656468.323552:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790656468.323671:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1790656468.323713:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1790656468.323730:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790656468.323733:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790656468.325081:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1790656468.325782:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1790656468.325829:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1790656468.325862:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1790656468.325873:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790656468.325875:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790656468.327536:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1790656468.328034:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1790656468.328098:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1790656468.328138:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1790656468.328154:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790656468.328174:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328202:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328209:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328215:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328222:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328228:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328247:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328253:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328261:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328267:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328274:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328334:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328349:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 9 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328364:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737088:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656468.328454:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328463:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328471:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737216:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656468.328500:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328509:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 18 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328518:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737344:0@lo:104: 00000100:00100000:0.0:1790656468.328557:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790656468.328647:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328656:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328676:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc43800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737472:0@lo:104: 00000100:00100000:0.0:1790656468.328702:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790656468.328731:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328739:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 18 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328747:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737600:0@lo:104: 00010000:00010000:0.0:1790656468.328771:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328777:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 18 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328783:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737728:0@lo:104: 00010000:00010000:0.0:1790656468.328800:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328807:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 18 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328813:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737856:0@lo:104: 00010000:00010000:0.0:1790656468.328850:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328857:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 18 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328876:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737984:0@lo:104: 00010000:00010000:0.0:1790656468.328900:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.328907:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 18 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.328914:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269738112:0@lo:104: 00000100:00100000:0.0:1790656468.328927:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff943911c5ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656468.329007:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790656468.329024:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.329037:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.329045:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.329052:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.329059:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.329067:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737344 00000100:00100000:2.0:1790656468.329073:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737344 00000100:00100000:2.0:1790656468.329102:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737472 00000100:00100000:2.0:1790656468.329104:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737472 00000100:00100000:2.0:1790656468.329111:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737600 00000100:00100000:2.0:1790656468.329114:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737600 00000100:00100000:2.0:1790656468.329120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737728 00000100:00100000:2.0:1790656468.329122:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737728 00000100:00100000:2.0:1790656468.329128:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737856 00000100:00100000:2.0:1790656468.329130:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737856 00000100:00100000:2.0:1790656468.329137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269737984 00000100:00100000:2.0:1790656468.329139:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269737984 00000100:00100000:2.0:1790656468.329145:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738112 00000100:00100000:2.0:1790656468.329147:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738112 00000100:00100000:2.0:1790656468.329165:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656468.329172:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:8449:x1877639269737344:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329184:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329249:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790656468.329254:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+9:8449:x1877639269737344:12345-0@lo:104: Request processed in 83us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329260:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656468.329275:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656468.329281:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439284c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+8:8449:x1877639269737472:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329288:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329316:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790656468.329321:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439284c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+8:8449:x1877639269737472:12345-0@lo:104: Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329326:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656468.329352:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656468.329358:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:8449:x1877639269737600:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329364:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329388:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790656468.329393:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+7:8449:x1877639269737600:12345-0@lo:104: Request processed in 36us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329398:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656468.329410:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656468.329423:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:8449:x1877639269737728:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329430:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329455:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790656468.329459:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+6:8449:x1877639269737728:12345-0@lo:104: Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329464:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656468.329476:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790656468.329481:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:8449:x1877639269737856:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329488:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329512:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790656468.329516:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:8449:x1877639269737856:12345-0@lo:104: Request processed in 36us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790656468.329533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790656468.329539:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:8449:x1877639269737984:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329545:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329571:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790656468.329575:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:8449:x1877639269737984:12345-0@lo:104: Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329580:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790656468.329614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790656468.329627:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:8449:x1877639269738112:12345-0@lo:104: 00010000:00010000:2.0:1790656468.329637:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329662:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1790656468.329667:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:8449:x1877639269738112:12345-0@lo:104: Request processed in 41us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.329672:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790656468.329691:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790656468.329696:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329703:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.329707:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329715:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.329722:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.329727:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.329754:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329761:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.329779:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439421ce800/0x9c3a6e82066eaa8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329808:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790656468.329812:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329817:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.329820:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329826:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.329831:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.329836:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.329850:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329856:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.329871:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c96400/0x9c3a6e82066eaa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329885:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790656468.329893:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329899:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cea00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.329902:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329909:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.329915:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.329920:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.329933:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329938:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.329944:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329950:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439421cea00/0x9c3a6e82066eaa4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329959:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790656468.329962:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329967:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.329969:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.329986:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.329992:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.329997:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.330010:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330016:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.330021:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330028:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97800/0x9c3a6e82066eaa41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330038:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790656468.330040:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330046:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031000 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.330049:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330056:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.330062:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.330073:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.330087:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330093:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.330098:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330104:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031000/0x9c3a6e82066eaa33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330115:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790656468.330118:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330124:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.330128:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330135:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.330141:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.330384:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737344:0@lo:104: 00000100:00100000:0.0:1790656468.330396:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc43800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737472:0@lo:104: 00000100:00100000:0.0:1790656468.330403:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737600:0@lo:104: 00000100:00100000:0.0:1790656468.330409:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737728:0@lo:104: 00000100:00100000:0.0:1790656468.330417:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737856:0@lo:104: 00000100:00100000:0.0:1790656468.330424:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737984:0@lo:104: 00000100:00100000:0.0:1790656468.330431:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269738112:0@lo:104: 10000000:01000000:2.0:1790656468.330470:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.330485:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330491:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.330503:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330509:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eaa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa10 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330518:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656468.330521:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330527:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ffc00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656468.330529:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330535:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656468.330540:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656468.330545:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790656468.330557:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330563:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656468.330567:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330573:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ffc00/0x9c3a6e82066ea9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea9e6 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.330586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656468.330616:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656468.330618:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656468.330624:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656468.330636:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738240:0@lo:103: 00000100:00100000:2.0:1790656468.330673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330706:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738752:0@lo:103: 00000100:00100000:2.0:1790656468.330724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330745:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656468.330749:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738624:0@lo:103: 00000100:00100000:2.0:1790656468.330766:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330817:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738368:0@lo:103: 00000100:00100000:2.0:1790656468.330845:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330855:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738880:0@lo:103: 00000100:00100000:2.0:1790656468.330893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330907:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790656468.330913:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738496:0@lo:103: 00000100:00100000:2.0:1790656468.330933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330943:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269739008:0@lo:103: 00000100:00100000:2.0:1790656468.330960:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656468.330982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738240 00000100:00100000:2.0:1790656468.330988:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738240 00010000:00010000:2.0:1790656468.331012:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 19 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738752 00000100:00100000:2.0:1790656468.331032:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738752 00010000:00010000:2.0:1790656468.331042:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 20 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331062:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738624 00000100:00100000:2.0:1790656468.331065:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738624 00010000:00010000:2.0:1790656468.331076:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 21 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331087:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738368 00000100:00100000:2.0:1790656468.331089:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738368 00010000:00010000:2.0:1790656468.331098:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 22 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738880 00000100:00100000:2.0:1790656468.331109:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738880 00010000:00010000:2.0:1790656468.331118:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 23 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269738496 00000100:00100000:2.0:1790656468.331128:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269738496 00010000:00010000:2.0:1790656468.331136:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 24 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331143:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739008 00000100:00100000:2.0:1790656468.331145:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739008 00010000:00010000:2.0:1790656468.331154:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 25 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656468.331165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656468.331171:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+25:3302:x1877639269738240:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331181:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331186:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 25 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331204:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 25 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331218:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cfe00/0x9c3a6e82066eaa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa8e expref: 25 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331244:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331276:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+24:3302:x1877639269738240:12345-0@lo:103: Request processed in 105us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656468.331297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656468.331303:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+23:3302:x1877639269738752:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331310:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331314:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 23 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331321:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 23 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331330:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013fea00/0x9c3a6e82066eaa3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa33 expref: 23 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331338:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331358:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+22:3302:x1877639269738752:12345-0@lo:103: Request processed in 56us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656468.331376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656468.331381:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3302:x1877639269738624:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331393:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331399:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 21 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331407:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 21 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331416:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421ce000/0x9c3a6e82066eaa48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa41 expref: 21 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331425:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331447:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3302:x1877639269738624:12345-0@lo:103: Request processed in 66us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331453:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656468.331467:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656468.331473:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269738368:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331480:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331484:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 19 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331492:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 19 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331501:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066eaa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa6b expref: 19 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331508:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331534:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3299:x1877639269738368:12345-0@lo:103: Request processed in 62us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331548:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656468.331562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790656468.331568:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3299:x1877639269738880:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331576:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331581:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331588:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331618:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900030800/0x9c3a6e82066eaa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa09 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331628:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331651:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3299:x1877639269738880:12345-0@lo:103: Request processed in 83us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790656468.331669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790656468.331676:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:3299:x1877639269738496:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331682:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331686:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 15 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331694:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 15 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331704:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900030a00/0x9c3a6e82066eaa56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eaa4f expref: 15 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331724:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331747:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3299:x1877639269738496:12345-0@lo:103: Request processed in 73us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331753:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790656468.331765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790656468.331771:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:3299:x1877639269739008:12345-0@lo:103: 00010000:00010000:2.0:1790656468.331779:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656468.331784:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331792:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331801:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96a00/0x9c3a6e82066ea9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea9df expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.331809:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656468.331828:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3299:x1877639269739008:12345-0@lo:103: Request processed in 58us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656468.331834:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790656468.331883:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738624:0@lo:103: 00000100:00100000:2.0:1790656468.331893:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738240:0@lo:103: 00000100:00100000:2.0:1790656468.331900:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269738752:0@lo:103: 00000100:00100000:2.0:1790656468.331928:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738496:0@lo:103: 00000100:00100000:2.0:1790656468.331934:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269739008:0@lo:103: 00000100:00100000:2.0:1790656468.331950:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738368:0@lo:103: 00000100:00100000:2.0:1790656468.331956:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269738880:0@lo:103: 00000100:00100000:0.0:1790656468.339988:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737088:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656468.340003:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1877639269737216:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656468.340049:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656468.341927:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656468.341963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656468.342073:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744448 00000100:00100000:0.0:1790656468.342083:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744448 00010000:00010000:0.0:1790656468.342120:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 10 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.342174:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744576 00000100:00100000:0.0:1790656468.342178:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744576 00010000:00010000:0.0:1790656468.342191:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 11 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656468.342207:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1790656468.342217:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2341:x1877639248744448:12345-192.168.203.23@tcp:103: 00010000:00010000:0.0:1790656468.342243:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656468.342250:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 11 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342262:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 11 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342280:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eaab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375d3 expref: 11 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342297:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656468.342345:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2341:x1877639248744448:12345-192.168.203.23@tcp:103: Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656468.342353:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1790656468.342371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1790656468.342378:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:2341:x1877639248744576:12345-192.168.203.23@tcp:103: 00010000:00010000:0.0:1790656468.342386:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656468.342390:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342409:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342419:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c800/0x9c3a6e82066eaaaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375cc expref: 9 pid: 5838 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342431:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342439:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342454:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342461:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342468:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342475:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342481:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656468.342485:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342494:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342521:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342532:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656468.342551:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:2341:x1877639248744576:12345-192.168.203.23@tcp:103: Request processed in 174us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656468.342558:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00010000:00010000:0.0:1790656468.342581:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342622:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656468.342629:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900031c00/0x9c3a6e82066eaae9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656468.705604:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656469.150807:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269739392:0@lo:400: 00000100:00100000:2.0:1790656469.150874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.150919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739392 00000100:00100000:1.0:1790656469.150927:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739392 00000100:00100000:2.0:1790656469.150943:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269739904:0@lo:400: 00000100:00100000:2.0:1790656469.150972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.150982:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656469.150994:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269739392:12345-0@lo:400: 00000100:00100000:2.0:1790656469.151083:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656469.151090:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269739520:0@lo:400: 00000100:00100000:2.0:1790656469.151116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.151199:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269739392:12345-0@lo:400: Request processed in 207us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656469.151206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656469.151223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739520 00000100:00100000:1.0:1790656469.151236:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739520 00000100:00100000:2.0:1790656469.151261:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269739392:0@lo:400: 00000100:00100000:1.0:1790656469.151268:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790656469.151276:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269739520:12345-0@lo:400: 00000100:00100000:1.0:1790656469.151317:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269739520:12345-0@lo:400: Request processed in 43us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656469.151323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656469.151444:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269739136:0@lo:400: 00000100:00100000:3.0:1790656469.151480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656469.151506:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269739648:0@lo:400: 00000100:00100000:3.0:1790656469.151541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656469.151667:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269739520:0@lo:400: 00000100:00100000:2.0:1790656469.151693:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269739264:0@lo:13: 00000100:00100000:2.0:1790656469.151720:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656469.151740:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269739776:0@lo:400: 00000100:00100000:2.0:1790656469.151758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656469.157043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739136 00000100:00100000:3.0:1790656469.157058:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739136 00000100:00100000:3.0:1790656469.157121:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790656469.157132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3301:x1877639269739136:12345-0@lo:400: 00000100:00080000:0.0:1790656469.157153:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656469.157169:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739264 00000100:00100000:0.0:1790656469.157175:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739264 00000100:00100000:3.0:1790656469.157203:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:3301:x1877639269739136:12345-0@lo:400: Request processed in 73us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.157210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790656469.157281:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269739136:0@lo:400: 00000100:00100000:3.0:1790656469.157322:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739904 00000100:00100000:3.0:1790656469.157327:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739904 00000100:00100000:3.0:1790656469.157360:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739648 00000100:00100000:3.0:1790656469.157364:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739648 00000100:00100000:3.0:1790656469.157379:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790656469.157386:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269739904:12345-0@lo:400: 00000100:00100000:3.0:1790656469.157425:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269739904:12345-0@lo:400: Request processed in 40us (6452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.157431:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790656469.157443:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790656469.157463:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269739648:12345-0@lo:400: 00000100:00100000:3.0:1790656469.157496:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269739648:12345-0@lo:400: Request processed in 34us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.157502:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656469.157569:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656469.157578:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269739264:12345-0@lo:13: 00002000:00000024:0.0:1790656469.157621:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656469.157667:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269739264:12345-0@lo:13: Request processed in 91us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656469.157673:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790656469.157692:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656469.157695:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790656469.158136:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bd3f480 x1877639269739904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656469.158164:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269739904:0@lo:400: 00010000:00080000:0.0:1790656469.158218:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bd3ea00 x1877639269739648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656469.158239:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269739648:0@lo:400: 00010000:00080000:2.0:1790656469.166311:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393f9e2a00 x1877639269739264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656469.166338:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269739264:0@lo:13: 00000100:00100000:3.0:1790656469.169338:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269739776 00000100:00100000:3.0:1790656469.169362:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269739776 00000100:00100000:3.0:1790656469.169435:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656469.169445:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269739776:12345-0@lo:400: 00000100:00100000:3.0:1790656469.169775:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269739776:12345-0@lo:400: Request processed in 331us (18015us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.169783:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656469.169855:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269739776:0@lo:400: 00000100:00080000:2.0:1790656469.170083:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656469.726902:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656469.754669:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656469.754702:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656469.754737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656469.754777:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656469.754954:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744960 00000100:00100000:3.0:1790656469.754964:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744960 00000100:00100000:3.0:1790656469.755026:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745088 00000100:00100000:3.0:1790656469.755030:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745088 00000100:00100000:3.0:1790656469.755050:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656469.755059:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248744960:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1790656469.755132:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248744960:12345-192.168.203.23@tcp:400: Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.755140:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656469.755156:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1790656469.755163:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248745088:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1790656469.755188:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248745088:12345-192.168.203.23@tcp:400: Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.755195:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1790656469.755700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744832 00000100:00100000:2.0:1790656469.755707:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744832 00000100:00100000:2.0:1790656469.755753:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1790656469.755769:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248744832:12345-192.168.203.23@tcp:400: 00000100:00100000:2.0:1790656469.755808:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248744832:12345-192.168.203.23@tcp:400: Request processed in 41us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656469.755815:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1790656469.755938:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248744704 00000100:00100000:0.0:1790656469.755943:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248744704 00000100:00100000:0.0:1790656469.755980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:0.0:1790656469.755988:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:2341:x1877639248744704:12345-192.168.203.23@tcp:400: 00000100:00100000:0.0:1790656469.756016:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:2341:x1877639248744704:12345-192.168.203.23@tcp:400: Request processed in 30us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656469.756023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00080000:1.0:1790656469.756521:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790656469.756527:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656469.756529:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1790656469.982780:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790656469.982787:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94390a3a0800 from 39 10000000:01000000:1.0:1790656469.982792:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790656469.982834:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656469.982857:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656469.982869:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656469.982891:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740032:0@lo:101: 00000100:00100000:1.0:1790656469.982960:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.985302:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656469.988093:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740032 00000100:00100000:3.0:1790656469.988108:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740032 00000100:00100000:3.0:1790656469.988178:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790656469.988187:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+12:5840:x1877639269740032:12345-0@lo:101: 00010000:00010000:3.0:1790656469.988393:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656469.988413:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96600/0x9c3a6e82066eaaf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaaf0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656469.988441:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96600/0x9c3a6e82066eaaf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaaf0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656469.988452:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96600/0x9c3a6e82066eaaf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaaf0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656469.988460:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96600, rc 0) 00000100:00100000:3.0:1790656469.988751:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269740032:12345-0@lo:101: Request processed in 564us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.988758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790656469.988846:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740032:0@lo:101: 00010000:00010000:1.0:1790656469.988874:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656469.988884:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656469.988956:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740160:0@lo:501: 00000100:00100000:1.0:1790656469.989151:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.989189:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656469.989826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740160 00000100:00100000:2.0:1790656469.989833:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740160 00000100:00100000:2.0:1790656469.989882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790656469.989890:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269740160:12345-0@lo:501: 00000100:00100000:1.0:1790656469.990351:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740160:0@lo:501: 00000100:00100000:1.0:1790656469.990390:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740288:0@lo:503: 00000100:00100000:1.0:1790656469.990436:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656469.990469:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656469.990558:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740288 00000100:00100000:3.0:1790656469.990563:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740288 00000100:00100000:3.0:1790656469.990581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790656469.990624:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740288:12345-0@lo:503: 00000100:00100000:3.0:1790656469.990894:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740288:12345-0@lo:503: Request processed in 306us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656469.990901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790656469.990991:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740288:0@lo:503: 00000100:00100000:2.0:1790656469.991423:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269740160:12345-0@lo:501: Request processed in 306us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656469.991430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790656469.992047:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8468:1877639269740416:0@lo:502: 00000100:00100000:2.0:1790656469.992111:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656469.992148:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656469.992195:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740416 00000100:00100000:0.0:1790656469.992201:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740416 00000100:00100000:0.0:1790656469.992247:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790656469.992264:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:8468:x1877639269740416:12345-0@lo:502: 00000100:00100000:0.0:1790656469.992744:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:8468:x1877639269740416:12345-0@lo:502: Request processed in 482us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656469.992752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790656469.992831:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8468:1877639269740416:0@lo:502: 00000100:00100000:2.0:1790656469.992870:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8468:1877639269740544:0@lo:502: 00000100:00100000:2.0:1790656469.992899:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656469.992933:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656469.992982:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740544 00000100:00100000:0.0:1790656469.992987:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740544 00000100:00100000:0.0:1790656469.993052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790656469.993059:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:8468:x1877639269740544:12345-0@lo:502: 00000100:00100000:0.0:1790656469.993184:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:8468:x1877639269740544:12345-0@lo:502: Request processed in 125us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656469.993199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790656469.993268:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8468:1877639269740544:0@lo:502: 00000040:00080000:2.0:1790656469.993287:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790656469.993426:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790656469.993449:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790656469.993458:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656469.993470:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656469.993485:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790656469.993488:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790656469.993497:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790656469.993518:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656469.993526:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656469.993534:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656469.993545:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740672:0@lo:101: 00000100:00100000:2.0:1790656469.993577:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.005922:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656470.007507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740672 00000100:00100000:1.0:1790656470.007538:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740672 00000100:00100000:1.0:1790656470.007772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790656470.007784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+13:5840:x1877639269740672:12345-0@lo:101: 00010000:00010000:1.0:1790656470.007803:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656470.007822:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148ce00/0x9c3a6e82066eab05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eaafe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.007851:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148ce00/0x9c3a6e82066eab05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eaafe expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.007863:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148ce00/0x9c3a6e82066eab05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eaafe expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.007871:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148ce00, rc 0) 00000100:00100000:1.0:1790656470.007965:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740672:12345-0@lo:101: Request processed in 183us (14387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656470.007971:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790656470.008107:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740672:0@lo:101: 00010000:00010000:2.0:1790656470.008126:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.008135:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656470.008207:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740800:0@lo:501: 00000100:00100000:2.0:1790656470.008251:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.008288:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656470.008350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740800 00000100:00100000:1.0:1790656470.008354:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740800 00000100:00100000:1.0:1790656470.008371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790656470.008379:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740800:12345-0@lo:501: 00000100:00100000:1.0:1790656470.008982:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740800:12345-0@lo:501: Request processed in 604us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656470.008989:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790656470.009586:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740800:0@lo:501: 00000100:00100000:2.0:1790656470.009663:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740928:0@lo:503: 00000100:00100000:2.0:1790656470.009734:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.009783:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656470.010010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269740928 00000100:00100000:1.0:1790656470.010016:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269740928 00000100:00100000:1.0:1790656470.010082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790656470.010097:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740928:12345-0@lo:503: 00000100:00100000:1.0:1790656470.010837:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269740928:12345-0@lo:503: Request processed in 740us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656470.010855:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790656470.010934:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269740928:0@lo:503: 00000100:00100000:1.0:1790656470.011393:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8469:1877639269741056:0@lo:502: 00000100:00100000:1.0:1790656470.011676:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.011746:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.011789:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741056 00000100:00100000:0.0:1790656470.011796:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741056 00000100:00100000:0.0:1790656470.011878:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790656470.011891:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8469:x1877639269741056:12345-0@lo:502: 00000100:00100000:0.0:1790656470.012084:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8469:x1877639269741056:12345-0@lo:502: Request processed in 193us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.012091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790656470.012165:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8469:1877639269741056:0@lo:502: 00000020:01000000:1.0:1790656470.012202:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656470.012211:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.012213:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790656470.012227:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790656470.012251:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8469:1877639269741184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.012283:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.012915:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.012950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741184 00000100:00100000:3.0:1790656470.012957:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741184 00000100:00100000:0.0:1790656470.013000:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790656470.013009:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8469:x1877639269741184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656470.013166:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:8469:x1877639269741184:12345-0@lo:502:llog_process_th.0 Request processed in 158us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.013173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790656470.013260:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8469:1877639269741184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656470.013284:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656470.013290:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.013291:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790656470.013295:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1790656470.013848:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1790656470.013869:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790656470.013879:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.013890:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656470.013900:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790656470.013902:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94392d856000 from 39 10000000:01000000:1.0:1790656470.013913:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790656470.013938:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.013946:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.013955:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.013973:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.014009:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.014408:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.014673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741312 00000100:00100000:2.0:1790656470.014680:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741312 00000100:00100000:2.0:1790656470.014733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790656470.014742:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:5840:x1877639269741312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656470.014753:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656470.014766:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481600/0x9c3a6e82066eab13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab0c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.014789:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481600/0x9c3a6e82066eab13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab0c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.014798:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481600/0x9c3a6e82066eab13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab0c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.014806:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481600, rc 0) 00000100:00100000:2.0:1790656470.014853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.014860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790656470.014960:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656470.014973:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.014982:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.015031:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.015057:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.015077:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.015117:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741440 00000100:00100000:0.0:1790656470.015121:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741440 00000100:00100000:0.0:1790656470.015154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790656470.015161:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.015713:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 551us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.015721:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790656470.015789:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.015817:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.015855:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.015882:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.015890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741568 00000100:00100000:3.0:1790656470.015895:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741568 00000100:00100000:3.0:1790656470.015936:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790656470.016043:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656470.016189:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.016206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790656470.016209:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656470.016970:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8470:1877639269741696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656470.017010:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656470.017072:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c94600 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.017159:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741696 00000100:00100000:2.0:1790656470.017164:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741696 00000100:00100000:2.0:1790656470.017201:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790656470.017208:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8470:x1877639269741696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656470.017781:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8470:x1877639269741696:12345-0@lo:502:llog_process_th.0 Request processed in 572us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.017794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790656470.017844:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8470:1877639269741696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656470.017881:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8470:1877639269741824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656470.017905:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656470.017954:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c94600 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.018029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741824 00000100:00100000:2.0:1790656470.018034:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741824 00000100:00100000:2.0:1790656470.018102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790656470.018110:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8470:x1877639269741824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656470.018270:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:8470:x1877639269741824:12345-0@lo:502:llog_process_th.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.018277:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790656470.018936:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8470:1877639269741824:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790656470.018978:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790656470.019066:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790656470.019087:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790656470.019097:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.019109:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656470.019118:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790656470.019120:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1790656470.019123:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790656470.019151:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.019160:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.019169:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.019185:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.019235:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.019268:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.019310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269741952 00000100:00100000:2.0:1790656470.019316:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269741952 00000100:00100000:2.0:1790656470.019353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790656470.019360:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:5840:x1877639269741952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656470.019371:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656470.019382:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480200/0x9c3a6e82066eab21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab1a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.019416:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480200/0x9c3a6e82066eab21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab1a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.019427:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480200/0x9c3a6e82066eab21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab1a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.019435:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480200, rc 0) 00000100:00100000:2.0:1790656470.019804:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269741952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 443us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.019810:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790656470.019851:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269741952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656470.019861:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.019867:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.019907:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.019924:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.019975:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.020102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742080 00000100:00100000:2.0:1790656470.020112:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742080 00000100:00100000:2.0:1790656470.020142:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790656470.020150:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269742080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.024210:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269742080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4051us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.024232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790656470.027394:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.027479:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.027564:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.027625:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.027818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742208 00000100:00100000:2.0:1790656470.027826:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742208 00000100:00100000:2.0:1790656470.027870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790656470.027879:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269742208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.028097:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269742208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.028105:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790656470.028406:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.029128:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8471:1877639269742336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656470.029256:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656470.029295:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f6203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.029352:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742336 00000100:00100000:2.0:1790656470.029358:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742336 00000100:00100000:2.0:1790656470.029405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790656470.029414:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8471:x1877639269742336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656470.029905:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8471:x1877639269742336:12345-0@lo:502:llog_process_th.0 Request processed in 491us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.029913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790656470.031894:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8471:1877639269742336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656470.031945:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656470.031955:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.031957:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790656470.031962:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790656470.032093:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8471:1877639269742464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.032155:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.032193:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.032298:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742464 00000100:00100000:3.0:1790656470.032306:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742464 00000100:00100000:3.0:1790656470.032392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790656470.032402:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8471:x1877639269742464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656470.032822:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:8471:x1877639269742464:12345-0@lo:502:llog_process_th.0 Request processed in 421us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.032830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790656470.032913:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8471:1877639269742464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656470.032936:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656470.032950:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.032952:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790656470.032957:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1790656470.036582:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790656470.036636:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790656470.036647:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.036660:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656470.036693:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790656470.036696:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943928721000 from 39 10000000:01000000:2.0:1790656470.036699:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790656470.036736:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.036745:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.036756:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656470.036781:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.036841:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.036887:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390394b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.037350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742592 00000100:00100000:0.0:1790656470.037358:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742592 00000100:00100000:0.0:1790656470.037416:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790656470.037425:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269742592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656470.037437:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656470.037450:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900031c00/0x9c3a6e82066eab2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab28 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.037482:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900031c00/0x9c3a6e82066eab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab28 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.037500:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900031c00/0x9c3a6e82066eab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab28 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.037516:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031c00, rc 0) 00000100:00100000:0.0:1790656470.037571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269742592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.037578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790656470.037611:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656470.037626:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656470.037642:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.037693:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.037722:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.037744:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.037804:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742720 00000100:00100000:3.0:1790656470.037809:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742720 00000100:00100000:3.0:1790656470.037829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790656470.037836:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269742720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656470.038243:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269742720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.038250:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790656470.038389:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.038566:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.038628:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.038658:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.038687:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742848 00000100:00100000:0.0:1790656470.038754:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742848 00000100:00100000:0.0:1790656470.038791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790656470.038798:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269742848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.038956:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269742848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.039072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790656470.039083:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269742848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.039796:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8472:1877639269742976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.039840:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.039955:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.040082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269742976 00000100:00100000:3.0:1790656470.040088:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269742976 00000100:00100000:3.0:1790656470.040123:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790656470.040132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8472:x1877639269742976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656470.040626:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8472:x1877639269742976:12345-0@lo:502:llog_process_th.0 Request processed in 494us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.040633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790656470.040801:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8472:1877639269742976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.040849:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8472:1877639269743104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.040885:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.040964:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.041094:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743104 00000100:00100000:0.0:1790656470.041099:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743104 00000100:00100000:0.0:1790656470.041135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790656470.041143:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8472:x1877639269743104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656470.041324:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8472:x1877639269743104:12345-0@lo:502:llog_process_th.0 Request processed in 181us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656470.041757:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8472:1877639269743104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790656470.041783:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790656470.042044:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790656470.042066:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790656470.042079:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.042090:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656470.042099:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790656470.042102:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790656470.042104:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:0.0:1790656470.042113:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:2.0:1790656470.042129:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.042146:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.042156:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656470.042173:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.042208:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.042244:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390394b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.042247:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743232 00000100:00100000:3.0:1790656470.042252:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743232 00000100:00100000:3.0:1790656470.042286:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790656470.042294:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269743232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656470.042304:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656470.042316:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97e00/0x9c3a6e82066eab3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab36 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.042553:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97e00/0x9c3a6e82066eab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab36 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.042565:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97e00/0x9c3a6e82066eab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab36 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.042573:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97e00, rc 0) 00000100:00100000:3.0:1790656470.042636:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.042652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790656470.042793:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656470.042806:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.042814:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656470.042860:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.042885:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.042949:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390394b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.044903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743360 00000100:00100000:0.0:1790656470.044915:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743360 00000100:00100000:0.0:1790656470.045093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790656470.045104:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.046057:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 839us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.046066:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.046066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790656470.046113:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656470.046165:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656470.046250:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390394b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656470.046290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743488 00000100:00100000:3.0:1790656470.046296:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743488 00000100:00100000:3.0:1790656470.046364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790656470.046385:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656470.046561:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.046568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790656470.046810:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.046989:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8473:1877639269743616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.047028:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.047778:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554540 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.047811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743616 00000100:00100000:0.0:1790656470.047817:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743616 00000100:00100000:2.0:1790656470.047862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790656470.047909:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8473:x1877639269743616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656470.048144:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8473:x1877639269743616:12345-0@lo:502:llog_process_th.0 Request processed in 238us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.048153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790656470.048170:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8473:1877639269743616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656470.048199:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656470.048207:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.048209:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790656470.048216:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790656470.048259:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8473:1877639269743744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656470.048293:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.048395:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554540 going to sleep for 11 seconds 00000100:00100000:0.0:1790656470.048426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743744 00000100:00100000:0.0:1790656470.048430:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743744 00000100:00100000:0.0:1790656470.048458:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790656470.048465:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8473:x1877639269743744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656470.048669:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8473:x1877639269743744:12345-0@lo:502:llog_process_th.0 Request processed in 203us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.048676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790656470.048730:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8473:1877639269743744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656470.048746:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656470.048750:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656470.048752:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790656470.048755:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790656470.048936:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790656470.048964:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790656470.048972:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.048983:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656470.048992:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790656470.048994:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94390a368000 from 1 10000000:01000000:0.0:1790656470.049002:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790656470.049308:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.049318:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.049328:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656470.049343:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.049370:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656470.049446:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656470.049735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269743872 00000100:00100000:2.0:1790656470.049740:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269743872 00000100:00100000:2.0:1790656470.049802:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790656470.049810:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269743872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656470.049820:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656470.049832:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481400/0x9c3a6e82066eab4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.049853:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481400/0x9c3a6e82066eab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab44 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.049863:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481400/0x9c3a6e82066eab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab44 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.049870:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481400, rc 0) 00000100:00100000:2.0:1790656470.049904:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269743872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.049910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790656470.049967:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269743872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656470.049979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.049987:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656470.050040:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269744000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.050062:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656470.050165:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620780 going to sleep for 11 seconds 00000100:00100000:1.0:1790656470.050196:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744000 00000100:00100000:1.0:1790656470.050200:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744000 00000100:00100000:1.0:1790656470.050229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790656470.050236:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269744000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656470.050414:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269744000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (349us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656470.050421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790656470.050533:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269744000:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1790656470.050554:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790656470.050559:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656470.050577:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656470.202905:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656470.203512:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745216 00000100:00100000:2.0:1790656470.203523:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745216 00000100:00100000:2.0:1790656470.203582:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1790656470.203618:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:5583:x1877639248745216:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1790656470.203634:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656470.203651:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480400/0x9c3a6e82066eab52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237635 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.203687:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480400/0x9c3a6e82066eab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237635 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.203698:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480400/0x9c3a6e82066eab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237635 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656470.203707:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480400, rc 0) 00000100:00100000:2.0:1790656470.203760:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745216:12345-192.168.203.23@tcp:101: Request processed in 168us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656470.203767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:1.0:1790656470.207264:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656470.207484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745344 00000100:00100000:3.0:1790656470.207494:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745344 00000100:00100000:3.0:1790656470.207543:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1790656470.207552:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745344:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1790656470.207887:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745344:12345-192.168.203.23@tcp:501: Request processed in 334us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.207895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1790656470.215439:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656470.215735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745472 00000100:00100000:0.0:1790656470.215744:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745472 00000100:00100000:0.0:1790656470.215847:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:0.0:1790656470.215857:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745472:12345-192.168.203.23@tcp:503: 00000100:00100000:0.0:1790656470.216099:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745472:12345-192.168.203.23@tcp:503: Request processed in 243us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.216107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:1.0:1790656470.224490:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656470.224630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745600 00000100:00100000:3.0:1790656470.224640:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745600 00000100:00100000:3.0:1790656470.224748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:3.0:1790656470.224759:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:6056:x1877639248745600:12345-192.168.203.23@tcp:502: 00000100:00100000:3.0:1790656470.225032:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:6056:x1877639248745600:12345-192.168.203.23@tcp:502: Request processed in 274us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.225040:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1790656470.230095:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656470.230211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745728 00000100:00100000:0.0:1790656470.230233:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745728 00000100:00100000:0.0:1790656470.230286:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:0.0:1790656470.230296:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:6056:x1877639248745728:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790656470.230561:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:6056:x1877639248745728:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 265us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656470.230569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:1.0:1790656470.235204:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656470.235449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745856 00000100:00100000:3.0:1790656470.235459:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745856 00000100:00100000:3.0:1790656470.235514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:3.0:1790656470.235528:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248745856:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656470.235545:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656470.235561:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97a00/0x9c3a6e82066eab59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a23763c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.235622:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97a00/0x9c3a6e82066eab59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23763c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.235642:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97a00/0x9c3a6e82066eab59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23763c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656470.235651:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97a00, rc 0) 00000100:00100000:3.0:1790656470.235704:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248745856:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 181us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656470.235711:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:1.0:1790656470.242423:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656470.242493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248745984 00000100:00100000:0.0:1790656470.242503:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248745984 00000100:00100000:0.0:1790656470.242558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:0.0:1790656470.242568:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248745984:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656470.242842:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248745984:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 274us (426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790656470.242850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:0.0:1790656470.686862:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269744128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656470.686926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656470.687088:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744128 00000100:00100000:1.0:1790656470.687096:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744128 00000100:00100000:1.0:1790656470.687148:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790656470.687157:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269744128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656470.687188:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656470.687342:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269744128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656470.687350:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790656470.687663:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bd3e680 x1877639269744128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656470.687682:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269744128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656470.750898:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656471.776185:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790656472.073381:0:8510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc8632ab0 20000000:00000080:0.0:1790656472.073460:0:8510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94393fa33800 uarg=0000000000000000 20000000:01000000:0.0:1790656472.073494:0:8510:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790656472.073499:0:8510:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790656472.073503:0:8510:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790656472.078750:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1790656472.079075:0:8510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790656472.092857:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790656472.092940:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790656472.093022:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790656472.093039:0:8510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790656472.093058:0:8510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093076:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093084:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093092:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093102:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093110:0:8510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093157:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093173:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 9 pid: 5837 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.093188:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744256:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656472.093302:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093311:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 18 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.093321:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744384:0@lo:104: 00000100:00100000:1.0:1790656472.093356:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656472.093386:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093395:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 18 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.093403:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744512:0@lo:104: 00000100:00100000:1.0:1790656472.093423:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656472.093450:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656472.093458:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 18 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.093479:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744640:0@lo:104: 00000100:00100000:1.0:1790656472.093501:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554600 going to sleep for 11 seconds 00000100:00100000:0.0:1790656472.093615:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790656472.093634:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656472.093656:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744384 00000100:00100000:0.0:1790656472.093662:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744384 00000100:00100000:0.0:1790656472.093695:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744512 00000100:00100000:0.0:1790656472.093698:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744512 00000100:00100000:0.0:1790656472.093707:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744640 00000100:00100000:0.0:1790656472.093709:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744640 00000100:00100000:0.0:1790656472.093722:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790656472.093730:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:8510:x1877639269744384:12345-0@lo:104: 00010000:00010000:0.0:1790656472.093742:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.093798:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656472.093804:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:8510:x1877639269744384:12345-0@lo:104: Request processed in 75us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.093811:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790656472.093834:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790656472.093840:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:8510:x1877639269744512:12345-0@lo:104: 00010000:00010000:0.0:1790656472.093848:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.093881:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790656472.093886:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:8510:x1877639269744512:12345-0@lo:104: Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.093892:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790656472.093919:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790656472.093925:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:8510:x1877639269744640:12345-0@lo:104: 00010000:00010000:0.0:1790656472.093932:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.093957:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790656472.093962:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:8510:x1877639269744640:12345-0@lo:104: Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.093968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790656472.093984:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790656472.093990:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.093997:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656472.094001:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094009:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656472.094027:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656472.094032:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656472.094058:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094064:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656472.094082:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094088:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439421cec00/0x9c3a6e82066ea9fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eaa02 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094101:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656472.094105:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094110:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656472.094112:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094119:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656472.094125:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656472.094130:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656472.094151:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094156:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656472.094161:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094167:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031600/0x9c3a6e82066ea930 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea937 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094176:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656472.094179:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094183:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656472.094185:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094191:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656472.094197:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656472.094202:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656472.094226:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094233:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656472.094249:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094264:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439421cf400/0x9c3a6e82066ea8ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ea8d5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094280:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656472.094282:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656472.094284:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656472.094291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656472.094309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269744768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656472.094336:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656472.094368:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656472.094373:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269744896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656472.094392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656472.094414:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269745024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656472.094433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656472.094462:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744768 00000100:00100000:0.0:1790656472.094466:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744768 00010000:00010000:0.0:1790656472.094482:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 19 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.094496:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269744896 00000100:00100000:0.0:1790656472.094498:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269744896 00010000:00010000:0.0:1790656472.094508:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 20 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.094518:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745024 00000100:00100000:0.0:1790656472.094520:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745024 00010000:00010000:0.0:1790656472.094529:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 21 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.094555:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790656472.094561:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3301:x1877639269744768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656472.094571:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656472.094576:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 21 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094584:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 21 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094611:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656472.094641:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3301:x1877639269744768:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.094647:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790656472.094661:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790656472.094666:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3301:x1877639269744896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656472.094673:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656472.094677:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 20 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094684:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 20 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094692:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656472.094713:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3301:x1877639269744896:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.094718:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790656472.094730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790656472.094742:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269745024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656472.094750:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656472.094754:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 19 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094761:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 19 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.094769:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656472.094794:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269745024:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.094800:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790656472.094832:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269745024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656472.094854:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269744896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656472.094864:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269744768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656472.095143:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013ff600/0x9c3a6e82066eaa02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea9fb expref: 18 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.095154:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744384:0@lo:104: 00010000:00010000:1.0:1790656472.095164:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013fe800/0x9c3a6e82066ea937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea930 expref: 17 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.095172:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744512:0@lo:104: 00010000:00010000:1.0:1790656472.095181:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148d800/0x9c3a6e82066ea8d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ea8ce expref: 16 pid: 5838 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656472.095190:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744640:0@lo:104: 00000100:00100000:1.0:1790656472.099510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656472.099545:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877639269744256:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656472.099739:0:8510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.099996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746112 00000100:00100000:0.0:1790656472.100003:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746112 00010000:00010000:0.0:1790656472.100035:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.100072:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1790656472.100081:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2341:x1877639248746112:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656472.100095:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656472.100100:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100112:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100140:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013ff400/0x9c3a6e82066eaabf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237604 expref: 10 pid: 5837 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100155:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100164:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100180:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100188:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100194:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100200:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100216:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148c200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656472.100220:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100228:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100246:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656472.100266:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656472.100318:0:8510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656472.100328:0:8510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656472.100335:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eab60 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656472.101174:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:2341:x1877639248746112:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1089us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656472.101184:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00010000:00010000:3.0:1790656472.800650:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656473.669103:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656473.670735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746240 00000100:00100000:3.0:1790656473.670748:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746240 00000100:00100000:3.0:1790656473.670810:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:3.0:1790656473.670820:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:5583:x1877639248746240:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656473.670838:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656473.670855:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237643 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656473.670882:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656473.670911:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656473.670921:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656473.670985:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248746240:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 165us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656473.670992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:3.0:1790656473.695729:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656473.696356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746368 00000100:00100000:1.0:1790656473.696367:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746368 00000100:00100000:1.0:1790656473.696427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:1.0:1790656473.696438:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248746368:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656473.697227:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248746368:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 788us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656473.697235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:1.0:1790656473.700651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656473.700725:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746496 00000100:00100000:3.0:1790656473.700734:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746496 00000100:00100000:3.0:1790656473.700793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1790656473.700803:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248746496:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656473.701000:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:5583:x1877639248746496:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 197us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656473.701007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:1.0:1790656473.716560:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656473.730287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746624 00000100:00100000:0.0:1790656473.730300:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746624 00000100:00100000:3.0:1790656473.730437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1790656473.730448:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:6115:x1877639248746624:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790656473.730714:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:6115:x1877639248746624:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 266us (14218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656473.730722:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1790656473.745972:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656473.749282:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746752 00000100:00100000:1.0:1790656473.749312:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746752 00000100:00100000:1.0:1790656473.749375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1790656473.749386:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:6115:x1877639248746752:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790656473.749651:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:6115:x1877639248746752:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 266us (3687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656473.749660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00010000:00010000:0.0:1790656473.833804:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790656474.015715:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790656474.015722:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94390a3a0800 from 4 10000000:01000000:2.0:1790656474.015727:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790656474.015768:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656474.015797:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656474.015807:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656474.015833:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656474.015896:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656474.015942:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439280029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.016035:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745152 00000100:00100000:3.0:1790656474.016042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745152 00000100:00100000:3.0:1790656474.016167:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790656474.016180:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269745152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656474.016203:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656474.016215:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.016236:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.016246:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.016254:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656474.016295:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.016301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790656474.016385:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656474.016398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656474.016420:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656474.016475:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656474.016497:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656474.016521:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439280029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.016661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745280 00000100:00100000:3.0:1790656474.016665:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745280 00000100:00100000:3.0:1790656474.016693:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790656474.016699:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.016911:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.016917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790656474.016946:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.016971:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.017011:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.017027:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.017037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745408 00000100:00100000:3.0:1790656474.017044:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745408 00000100:00100000:3.0:1790656474.017058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790656474.017063:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.017181:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.017187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790656474.017229:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.017712:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8581:1877639269745536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656474.017747:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.017776:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656474.017901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745536 00000100:00100000:1.0:1790656474.017907:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745536 00000100:00100000:1.0:1790656474.017929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790656474.017936:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8581:x1877639269745536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656474.018067:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8581:x1877639269745536:12345-0@lo:502:llog_process_th.0 Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656474.018074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790656474.018145:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8581:1877639269745536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656474.018170:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656474.018178:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656474.018181:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790656474.018188:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94390a3a0800 00000020:00000080:3.0:1790656474.018203:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790656474.018275:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8581:1877639269745664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656474.018307:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.018318:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656474.018382:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745664 00000100:00100000:2.0:1790656474.018387:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745664 00000100:00100000:2.0:1790656474.018430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790656474.018437:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8581:x1877639269745664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656474.018554:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:8581:x1877639269745664:12345-0@lo:502:llog_process_th.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656474.018561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790656474.018831:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8581:1877639269745664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656474.018852:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656474.018857:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656474.018858:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790656474.018862:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790656474.018909:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790656474.018924:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656474.018937:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.018948:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656474.018957:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656474.018960:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94392d856000 from 4 10000000:01000000:3.0:1790656474.018962:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656474.018983:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.018991:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.018999:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656474.019012:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.019037:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.019059:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.019071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745792 00000100:00100000:3.0:1790656474.019074:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745792 00000100:00100000:3.0:1790656474.019094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790656474.019100:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269745792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656474.019108:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656474.019118:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.019136:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.019151:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.019160:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656474.019200:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269745792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.019207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790656474.019237:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656474.019248:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.019256:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656474.019293:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.019314:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.019327:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.019337:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269745920 00000100:00100000:3.0:1790656474.019340:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269745920 00000100:00100000:3.0:1790656474.019360:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790656474.019366:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269745920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.019742:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269745920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.019749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790656474.019777:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269745920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.019810:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.019842:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.019859:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.019870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746048 00000100:00100000:3.0:1790656474.019873:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746048 00000100:00100000:3.0:1790656474.019893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790656474.019899:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269746048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.020006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269746048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.020013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790656474.020047:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656474.023770:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8582:1877639269746176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656474.023845:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656474.023886:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656474.024552:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746176 00000100:00100000:2.0:1790656474.024560:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746176 00000100:00100000:2.0:1790656474.024636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790656474.024647:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8582:x1877639269746176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656474.024872:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8582:x1877639269746176:12345-0@lo:502:llog_process_th.0 Request processed in 226us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656474.024879:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790656474.026805:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8582:1877639269746176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656474.026857:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656474.026869:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656474.026871:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790656474.026878:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94392d856000 00000020:00000080:1.0:1790656474.026881:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790656474.029352:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8582:1877639269746304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656474.029776:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656474.029823:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287d66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656474.032369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746304 00000100:00100000:2.0:1790656474.032381:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746304 00000100:00100000:2.0:1790656474.032447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790656474.032458:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8582:x1877639269746304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656474.032890:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:8582:x1877639269746304:12345-0@lo:502:llog_process_th.0 Request processed in 433us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656474.032898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790656474.033914:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8582:1877639269746304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656474.033963:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656474.033970:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656474.033972:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790656474.033977:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790656474.034567:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790656474.034587:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656474.034615:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.035571:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656474.035584:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656474.035586:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943928721000 from 4 10000000:01000000:3.0:1790656474.035617:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656474.035900:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.035909:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.035933:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656474.035954:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.036005:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.036039:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.036060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746432 00000100:00100000:3.0:1790656474.036066:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746432 00000100:00100000:3.0:1790656474.036113:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790656474.036122:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269746432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656474.036134:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656474.036145:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eab8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.036166:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.036176:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.036184:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96c00, rc 0) 00000100:00100000:3.0:1790656474.036232:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269746432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.036239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790656474.036279:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656474.036291:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.036305:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656474.036358:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.037812:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.037856:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656474.037904:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746560 00000100:00100000:1.0:1790656474.037911:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746560 00000100:00100000:1.0:1790656474.038490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790656474.038510:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269746560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656474.038783:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269746560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656474.038790:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790656474.038946:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.038989:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656474.039028:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.042726:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656474.045323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746688 00000100:00100000:2.0:1790656474.045336:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746688 00000100:00100000:2.0:1790656474.045398:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790656474.045570:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269746688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656474.045877:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269746688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656474.045885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790656474.045995:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269746688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656474.050770:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8585:1877639269746816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656474.050843:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656474.050890:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790656474.050933:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746816 00000100:00100000:1.0:1790656474.050941:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746816 00000100:00100000:1.0:1790656474.050982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790656474.050991:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:8585:x1877639269746816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656474.051206:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:8585:x1877639269746816:12345-0@lo:502:llog_process_th.0 Request processed in 215us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656474.051213:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790656474.051463:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8585:1877639269746816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790656474.051557:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656474.051567:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656474.051569:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790656474.051577:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943928721000 00000020:00000080:0.0:1790656474.051579:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790656474.051995:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8585:1877639269746944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656474.052029:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656474.052058:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656474.052134:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269746944 00000100:00100000:3.0:1790656474.052139:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269746944 00000100:00100000:3.0:1790656474.052172:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790656474.052179:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:8585:x1877639269746944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656474.052311:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:8585:x1877639269746944:12345-0@lo:502:llog_process_th.0 Request processed in 132us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.052318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790656474.052389:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:8585:1877639269746944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790656474.052417:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656474.052421:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656474.052423:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790656474.052427:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790656474.052651:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790656474.052669:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656474.052678:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656474.052689:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656474.271883:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269747072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656474.271959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.272070:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747072 00000100:00100000:3.0:1790656474.272078:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747072 00000100:00100000:3.0:1790656474.272138:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656474.272147:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269747072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656474.272179:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656474.272240:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269747072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.272246:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790656474.272291:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6edf80 x1877639269747072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656474.272308:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269747072:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790656474.272361:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790656474.284939:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269747456:0@lo:400:kworker.0 00000100:00100000:0.0:1790656474.285004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656474.285040:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656474.285046:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269747584:0@lo:400:kworker.0 00000100:00100000:0.0:1790656474.285068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656474.285105:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747584 00000100:00100000:0.0:1790656474.285112:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747584 00000100:00100000:0.0:1790656474.285161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790656474.285169:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269747584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656474.285231:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269747584:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656474.285238:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790656474.285261:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656474.285288:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269747584:0@lo:400:kworker.0 00000100:00100000:1.0:1790656474.285356:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269747200:0@lo:400:kworker.0 00000100:00100000:1.0:1790656474.285383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656474.285416:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656474.285421:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269747328:0@lo:400:kworker.0 00000100:00100000:1.0:1790656474.285440:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656474.285635:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747456 00000100:00100000:3.0:1790656474.285640:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747456 00000100:00100000:3.0:1790656474.285674:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656474.285681:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656474.285719:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269747456:12345-0@lo:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.285725:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656474.285742:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747200 00000100:00100000:3.0:1790656474.285745:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747200 00000100:00100000:3.0:1790656474.285762:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747328 00000100:00100000:3.0:1790656474.285764:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747328 00000100:00100000:3.0:1790656474.285779:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790656474.285785:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656474.285818:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269747200:12345-0@lo:400:kworker.0 Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.285835:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790656474.285848:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790656474.285853:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656474.285879:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269747328:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.285884:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790656474.285912:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269747328:0@lo:400:kworker.0 00000100:00100000:3.0:1790656474.285922:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269747200:0@lo:400:kworker.0 00010000:00080000:3.0:1790656474.285952:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bc43480 x1877639269747456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656474.285962:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269747456:0@lo:400:kworker.0 00000100:00080000:1.0:1790656474.286078:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790656474.286082:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790656474.859848:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656474.877485:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656474.877530:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656474.877610:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248746880 00000100:00100000:3.0:1790656474.877629:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248746880 00000100:00100000:3.0:1790656474.877679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:3.0:1790656474.877688:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248746880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656474.877754:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248746880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.877762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:2.0:1790656474.878273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656474.878307:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656474.878339:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747008 00000100:00100000:3.0:1790656474.878344:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747008 00000100:00100000:3.0:1790656474.878402:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:3.0:1790656474.878410:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248747008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656474.878446:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248747008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656474.878466:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00080000:0.0:1790656474.881192:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656474.891581:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747136 00000100:00100000:1.0:1790656474.891603:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747136 00000100:00080000:1.0:1790656474.897454:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656474.897587:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747264 00000100:00100000:1.0:1790656474.897789:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747264 00000100:00100000:1.0:1790656474.897822:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656474.897832:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656474.897906:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 76us (20375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656474.897913:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656474.897940:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1790656474.897946:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747264:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656474.897966:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747264:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (19659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656474.897972:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00080000:1.0:1790656474.897984:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656475.806963:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656475.806983:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269747712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656475.807042:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656475.807237:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747712 00000100:00100000:3.0:1790656475.807245:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747712 00000100:00100000:3.0:1790656475.807287:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656475.807296:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269747712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656475.807328:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656475.807372:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269747712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656475.807379:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790656475.807485:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bd3c700 x1877639269747712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656475.807503:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269747712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790656475.872825:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656476.896505:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656477.919173:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656478.955435:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656478.956424:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1790656479.390885:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269747840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656479.390960:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656479.391182:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747840 00000100:00100000:3.0:1790656479.391191:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747840 00000100:00100000:3.0:1790656479.391257:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790656479.391267:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269747840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656479.391301:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656479.391356:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269747840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656479.391363:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790656479.391402:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6edf80 x1877639269747840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656479.391421:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269747840:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790656479.391579:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656479.392085:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269748224:0@lo:400:kworker.0 00000100:00100000:2.0:1790656479.392134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656479.392173:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656479.392179:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269748352:0@lo:400:kworker.0 00000100:00100000:2.0:1790656479.392202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656479.392265:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269748096:0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.392291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656479.392321:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790656479.392326:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269747968:0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.392368:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656479.392393:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269748480:0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.392413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656479.392449:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269747968 00000100:00100000:0.0:1790656479.392454:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269747968 00000100:00100000:0.0:1790656479.392485:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790656479.392493:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.392535:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269747968:12345-0@lo:400:kworker.0 Request processed in 43us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656479.392541:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790656479.392575:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269747968:0@lo:400:kworker.0 00000100:00100000:1.0:1790656479.398170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748224 00000100:00100000:1.0:1790656479.398185:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748224 00000100:00100000:1.0:1790656479.398278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748096 00000100:00100000:1.0:1790656479.398283:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748096 00000100:00100000:1.0:1790656479.398297:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748480 00000100:00100000:1.0:1790656479.398300:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748480 00000100:00100000:1.0:1790656479.398317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790656479.398327:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269748224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790656479.398440:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656479.398476:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748352 00000100:00100000:0.0:1790656479.398480:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748352 00000100:00100000:0.0:1790656479.398513:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656479.398520:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.398657:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269748352:12345-0@lo:400:kworker.0 Request processed in 137us (6453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656479.398664:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790656479.398683:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656479.399030:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269748224:12345-0@lo:400:kworker.0 Request processed in 704us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656479.399040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790656479.399055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790656479.399062:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269748096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656479.399162:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269748096:12345-0@lo:400:kworker.0 Request processed in 100us (6869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656479.399168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790656479.399180:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790656479.399187:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656479.399214:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269748480:12345-0@lo:400:kworker.0 Request processed in 28us (6799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656479.399219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790656479.399809:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269748096:0@lo:400:kworker.0 00000100:00100000:0.0:1790656479.399835:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269748480:0@lo:400:kworker.0 00010000:00080000:2.0:1790656479.399927:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47df80 x1877639269748352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656479.399937:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269748352:0@lo:400:kworker.0 00000100:00100000:2.0:1790656479.399949:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269748224:0@lo:400:kworker.0 00010000:00010000:3.0:1790656479.967625:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656480.009132:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656480.009192:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656480.009253:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656480.009253:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747392 00000100:00100000:0.0:1790656480.009265:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747392 00000100:00100000:3.0:1790656480.009302:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656480.009329:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747520 00000100:00100000:0.0:1790656480.009333:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:2.0:1790656480.009336:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747520 00000100:00100000:0.0:1790656480.009347:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248747392:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656480.009392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:2.0:1790656480.009403:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248747520:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656480.009416:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248747392:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656480.009444:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248747520:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656480.009449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:2.0:1790656480.009455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1790656480.009516:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747648 00000100:00100000:0.0:1790656480.009521:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747648 00000100:00100000:0.0:1790656480.009561:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747776 00000100:00100000:0.0:1790656480.009565:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747776 00000100:00100000:0.0:1790656480.009586:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00080000:2.0:1790656480.009623:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656480.009629:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656480.009633:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656480.009634:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747648:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656480.009658:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790656480.009667:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790656480.009688:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747648:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 57us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656480.009696:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1790656480.009712:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1790656480.009720:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656480.009746:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248747776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656480.009753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1790656480.927749:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269748608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656480.927836:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656480.927937:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748608 00000100:00100000:1.0:1790656480.927946:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748608 00000100:00100000:1.0:1790656480.927999:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790656480.928008:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269748608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656480.928051:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656480.928100:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269748608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656480.928125:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790656480.928184:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47fb80 x1877639269748608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656480.928205:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269748608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656480.993297:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656482.019701:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656483.038825:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656484.072454:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656484.511887:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269748864:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.511976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512051:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269749376:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512081:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512127:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790656484.512134:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269748736:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512166:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512188:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269749248:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512239:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269748992:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512283:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656484.512288:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269749120:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512309:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.512344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748864 00000100:00100000:1.0:1790656484.512352:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748864 00000100:00100000:1.0:1790656484.512404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749248 00000100:00100000:1.0:1790656484.512407:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749248 00000100:00100000:1.0:1790656484.512432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748992 00000100:00100000:1.0:1790656484.512435:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748992 00000100:00100000:1.0:1790656484.512465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790656484.512475:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269748864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512538:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269748864:12345-0@lo:400:kworker.0 Request processed in 63us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790656484.512565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790656484.512572:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512634:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269749248:12345-0@lo:400:kworker.0 Request processed in 61us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790656484.512652:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790656484.512658:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512689:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269748992:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512695:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790656484.512715:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749376 00000100:00100000:1.0:1790656484.512719:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749376 00000100:00100000:1.0:1790656484.512747:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749120 00000100:00100000:1.0:1790656484.512750:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749120 00000100:00100000:1.0:1790656484.512771:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656484.512778:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512809:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269749376:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512815:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656484.512826:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790656484.512832:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269749120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512871:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269749120:12345-0@lo:400:kworker.0 Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512877:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790656484.512895:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269748736 00000100:00100000:1.0:1790656484.512899:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269748736 00000100:00100000:1.0:1790656484.512926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790656484.512932:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269748736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.512976:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269748736:12345-0@lo:400:kworker.0 Request processed in 43us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656484.512982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1790656484.513017:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656484.513022:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656484.513025:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790656484.513064:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47df80 x1877639269749120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656484.513081:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269749120:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.513094:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269748992:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.513143:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269748736:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.513153:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269749248:0@lo:400:kworker.0 00000100:00100000:1.0:1790656484.513163:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269748864:0@lo:400:kworker.0 00010000:00080000:1.0:1790656484.513173:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5ea00 x1877639269749376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656484.513182:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269749376:0@lo:400:kworker.0 00000100:00100000:3.0:1790656484.514290:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656484.514355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656484.514434:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749504 00000100:00100000:1.0:1790656484.514442:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749504 00000100:00100000:1.0:1790656484.514489:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790656484.514497:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269749504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656484.514536:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656484.522871:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269749504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8362us (8503us total) trans 0 rc 0/0 00010000:00080000:3.0:1790656484.522874:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5ea00 x1877639269749504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656484.522895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790656484.522914:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269749504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790656485.093040:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656485.120187:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656485.120246:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656485.120444:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248747904 00000100:00100000:1.0:1790656485.120457:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248747904 00000100:00100000:1.0:1790656485.120518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:1.0:1790656485.120528:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248747904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656485.120627:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248747904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 100us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656485.120636:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:1.0:1790656485.120678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748032 00000100:00100000:1.0:1790656485.120683:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748032 00000100:00100000:1.0:1790656485.120729:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1790656485.120736:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656485.120765:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656485.120771:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00080000:2.0:1790656485.121083:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656485.141452:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656485.142060:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748160 00000100:00100000:2.0:1790656485.142093:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748160 00000100:00100000:2.0:1790656485.142564:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656485.142579:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2338:x1877639248748160:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:2.0:1790656485.142665:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaacd 00000100:00080000:2.0:1790656485.142681:0:6690:0:(import.c:65:import_set_state_nolock()) ffff94391f582800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790656485.142730:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1790656485.143279:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656485.143293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656485.144236:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+2:2338:x1877639248748160:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 1650us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656485.144249:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:0.0:1790656485.154224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656485.161247:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748288 00000100:00100000:3.0:1790656485.161268:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748288 00000100:00100000:3.0:1790656485.161438:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656485.161451:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2338:x1877639248748288:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:3.0:1790656485.161498:0:8825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaad4 00000100:00080000:3.0:1790656485.161511:0:8825:0:(import.c:65:import_set_state_nolock()) ffff94391f583800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790656485.161562:0:8825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790656485.162042:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+2:2338:x1877639248748288:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 591us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656485.162051:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00010000:00010000:3.0:1790656485.162133:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790656485.173179:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790656486.049540:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656486.049627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656486.052341:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749632 00000100:00100000:2.0:1790656486.052354:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749632 00000100:00100000:2.0:1790656486.052445:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790656486.052455:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269749632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656486.052478:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790656486.052490:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656486.052570:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269749632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656486.052578:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790656486.052677:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393f9e3800 x1877639269749632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656486.052764:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269749632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790656486.114018:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790656486.374786:0:9057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing yml_node 00010000:00010000:2.0:1790656487.135008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790656487.626716:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:2.0:1790656487.626725:0:6716:0:(genops.c:885:class_export_put()) final put ffff94391f587000/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:0.0:1790656487.626886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94391f587000/177b5748-b800-471f-9375-621ebde8193b for lustre-OST0000 00000020:00000080:0.0:1790656487.627031:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94391f582800 for lustre-OST0000 00010000:00010000:2.0:1790656488.160066:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790656489.171484:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:3.0:1790656489.171495:0:7645:0:(genops.c:885:class_export_put()) final put ffff94391f586000/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:1.0:1790656489.171579:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94391f586000/177b5748-b800-471f-9375-621ebde8193b for lustre-OST0001 00000020:00000080:1.0:1790656489.171675:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94391f583800 for lustre-OST0001 00010000:00010000:3.0:1790656489.191027:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656489.631648:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269749760:0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.631738:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269750016:0@lo:400:kworker.0 00000100:00100000:1.0:1790656489.632006:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269749888:0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.632283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656489.632350:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750144:0@lo:400:kworker.0 00000100:00100000:1.0:1790656489.632392:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656489.632469:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790656489.632475:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656489.632502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656489.632555:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750528 00000100:00100000:1.0:1790656489.632567:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750528 00000100:00100000:1.0:1790656489.632669:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790656489.632679:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656489.632728:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656489.632795:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656489.632802:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1790656489.632852:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5fb80 x1877639269750528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656489.632874:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790656489.633032:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656489.633046:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750144 00000100:00100000:1.0:1790656489.633326:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750144 00000100:00100000:1.0:1790656489.633375:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790656489.633383:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656489.633449:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750144:12345-0@lo:400:kworker.0 Request processed in 67us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656489.633456:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790656489.633472:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790656489.633491:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bc40a80 x1877639269750144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656489.633502:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750144:0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.635103:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750016 00000100:00100000:0.0:1790656489.635116:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750016 00000100:00100000:0.0:1790656489.635203:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790656489.635219:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656489.635297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656489.635336:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269750016:12345-0@lo:400:kworker.0 Request processed in 122us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656489.635346:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790656489.635364:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269750400:0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.635367:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749888 00000100:00100000:0.0:1790656489.635377:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749888 00000100:00100000:0.0:1790656489.635405:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790656489.635411:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269749888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.635446:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269749888:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656489.635452:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790656489.635475:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656489.635528:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269750016:0@lo:400:kworker.0 00000100:00100000:3.0:1790656489.635561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656489.635681:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269749888:0@lo:400:kworker.0 00000100:00100000:2.0:1790656489.636938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656489.636981:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269750272:0@lo:400:kworker.0 00000100:00100000:2.0:1790656489.637010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656489.637087:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750272 00000100:00100000:3.0:1790656489.637101:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750272 00000100:00100000:3.0:1790656489.637192:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790656489.637202:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269750272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656489.637585:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269750272:12345-0@lo:400:kworker.0 Request processed in 384us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656489.637623:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656489.638281:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750400 00000100:00100000:1.0:1790656489.638292:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750400 00000100:00100000:1.0:1790656489.638362:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656489.638373:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656489.638449:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269750400:12345-0@lo:400:kworker.0 Request processed in 79us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656489.638456:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790656489.638503:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bc43100 x1877639269750400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656489.638520:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269750400:0@lo:400:kworker.0 00000100:00080000:2.0:1790656489.638907:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656489.638976:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269750272:0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.639399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269749760 00000100:00100000:0.0:1790656489.639408:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269749760 00000100:00100000:0.0:1790656489.639462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790656489.639471:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269749760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656489.640879:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269749760:12345-0@lo:400:kworker.0 Request processed in 1404us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656489.640890:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790656489.642108:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269749760:0@lo:400:kworker.0 00010000:00010000:2.0:1790656490.207860:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656490.239167:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656490.239205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656490.239224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748416 00000100:00100000:1.0:1790656490.239235:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748416 00000100:00100000:3.0:1790656490.239323:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748544 00000100:00100000:3.0:1790656490.239329:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748544 00000100:00100000:1.0:1790656490.239413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:1.0:1790656490.239424:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248748416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656490.239457:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1790656490.239467:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656490.239493:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248748416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656490.239501:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:3.0:1790656490.239544:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656490.239551:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00080000:2.0:1790656490.240059:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1790656490.515403:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00000100:00100000:1.0:1790656491.167823:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656491.167888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656491.168227:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750656 00000100:00100000:2.0:1790656491.168235:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750656 00000100:00100000:2.0:1790656491.168358:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790656491.168368:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656491.168415:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656491.168463:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269750656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656491.168470:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1790656491.168552:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393f9e0700 x1877639269750656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656491.168616:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269750656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656491.168683:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790656491.232256:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656492.254826:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656493.279668:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790656493.285610:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:2.0:1790656494.303483:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656494.751003:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269751040:0@lo:400:kworker.0 00000100:00100000:0.0:1790656494.751088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656494.751480:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656494.751488:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269751168:0@lo:400:kworker.0 00000100:00100000:0.0:1790656494.751519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656494.751717:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751168 00000100:00100000:1.0:1790656494.751725:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751168 00000100:00100000:1.0:1790656494.751782:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790656494.751791:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269751168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656494.751847:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269751168:12345-0@lo:400:kworker.0 Request processed in 57us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656494.751854:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790656494.751876:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790656494.751907:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b97b100 x1877639269751168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656494.751920:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269751168:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752090:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269750784:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752123:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656494.752159:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269751296:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752181:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656494.752201:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790656494.752207:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269750912:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752227:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656494.752244:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269751424:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752291:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656494.752318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751040 00000100:00100000:2.0:1790656494.752322:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751040 00000100:00100000:2.0:1790656494.752361:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751296 00000100:00100000:2.0:1790656494.752365:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751296 00000100:00100000:2.0:1790656494.752378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750912 00000100:00100000:2.0:1790656494.752381:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750912 00000100:00100000:2.0:1790656494.752395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790656494.752402:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269751040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752563:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269751040:12345-0@lo:400:kworker.0 Request processed in 161us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656494.752569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790656494.752582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790656494.752588:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269751296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752644:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269751296:12345-0@lo:400:kworker.0 Request processed in 56us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656494.752650:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790656494.752661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790656494.752667:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752692:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269750912:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656494.752697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790656494.752716:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751424 00000100:00100000:2.0:1790656494.752719:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751424 00000100:00100000:2.0:1790656494.752740:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790656494.752746:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752774:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269751424:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656494.752780:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790656494.752810:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269750912:0@lo:400:kworker.0 00010000:00080000:2.0:1790656494.752829:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b979880 x1877639269751424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656494.752838:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269751424:0@lo:400:kworker.0 00000100:00100000:2.0:1790656494.752847:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269751296:0@lo:400:kworker.0 00000100:00100000:0.0:1790656494.752920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269750784 00000100:00100000:0.0:1790656494.752925:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269750784 00000100:00100000:0.0:1790656494.752959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790656494.752966:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269750784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656494.753003:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269750784:12345-0@lo:400:kworker.0 Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656494.753009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790656494.753174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790656494.753183:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269751552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656494.753211:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790656494.753245:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656494.753249:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656494.753268:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269751040:0@lo:400:kworker.0 00000100:00100000:3.0:1790656494.753379:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751552 00000100:00100000:3.0:1790656494.753384:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751552 00000100:00100000:3.0:1790656494.753485:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790656494.753493:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269751552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656494.753519:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656494.753562:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269751552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656494.753575:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790656494.754452:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269750784:0@lo:400:kworker.0 00010000:00080000:0.0:1790656494.754516:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b97aa00 x1877639269751552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656494.754533:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269751552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790656495.328335:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656495.359151:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656495.359657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748672 00000100:00100000:1.0:1790656495.359668:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748672 00000100:00100000:1.0:1790656495.359740:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:1.0:1790656495.359751:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248748672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656495.360120:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248748672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 369us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656495.360145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:2.0:1790656495.363536:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656495.363685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748800 00000100:00100000:0.0:1790656495.363694:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748800 00000100:00100000:0.0:1790656495.363767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1790656495.363777:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656495.363837:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248748800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656495.363844:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00080000:1.0:1790656495.364532:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790656495.555114:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00000100:00100000:1.0:1790656496.287210:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656496.287233:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656496.287298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656496.287735:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751680 00000100:00100000:2.0:1790656496.287743:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751680 00000100:00100000:2.0:1790656496.287823:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790656496.287834:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269751680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656496.287867:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656496.287914:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269751680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656496.287920:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790656496.287956:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393f9e2a00 x1877639269751680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656496.287973:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269751680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656496.288131:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790656496.354471:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790656497.283663:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 29 00:34:55 EDT 2026 00010000:00010000:1.0:1790656497.376904:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656498.403661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656499.423679:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656499.873144:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656499.873165:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269751808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656499.873244:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656499.879486:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269751936:0@lo:400:kworker.0 00000100:00100000:1.0:1790656499.879556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656499.879753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751936 00000100:00100000:0.0:1790656499.879762:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751936 00000100:00100000:0.0:1790656499.879820:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790656499.879829:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269751936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656499.882479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269751936:12345-0@lo:400:kworker.0 Request processed in 2642us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656499.882493:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790656499.882653:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269751936:0@lo:400:kworker.0 00000100:00100000:1.0:1790656499.882674:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656499.882689:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269752320:0@lo:400:kworker.0 00000100:00100000:1.0:1790656499.882742:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656499.882847:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752320 00000100:00100000:0.0:1790656499.882854:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752320 00000100:00100000:0.0:1790656499.882923:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790656499.882933:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269752320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656499.882988:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269752320:12345-0@lo:400:kworker.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656499.882994:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1790656499.883035:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a46d80 x1877639269752320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656499.883048:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269752320:0@lo:400:kworker.0 00000100:00080000:1.0:1790656499.883258:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656499.883583:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656499.883631:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269752448:0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.883673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656499.883713:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269751808 00000100:00100000:2.0:1790656499.883724:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269751808 00000100:00100000:2.0:1790656499.883768:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790656499.883777:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269751808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656499.883805:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656499.883842:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269751808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (10599us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656499.883848:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790656499.883881:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269752064:0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.883922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656499.883946:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656499.883953:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269752192:0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.883975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656499.884017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752448 00000100:00100000:2.0:1790656499.884022:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752448 00000100:00100000:2.0:1790656499.884050:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752064 00000100:00100000:2.0:1790656499.884053:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752064 00000100:00100000:2.0:1790656499.884065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752192 00000100:00100000:2.0:1790656499.884067:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752192 00000100:00100000:2.0:1790656499.884084:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790656499.884090:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.884128:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269752448:12345-0@lo:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656499.884133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790656499.884144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790656499.884150:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.884178:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269752064:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00010000:00080000:0.0:1790656499.884426:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5d180 x1877639269751808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656499.884445:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269751808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656499.885900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790656499.885940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790656499.885950:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.886020:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269752192:12345-0@lo:400:kworker.0 Request processed in 73us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656499.886026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790656499.886067:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790656499.886073:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656499.886101:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269752448:0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.886130:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269752192:0@lo:400:kworker.0 00000100:00100000:2.0:1790656499.886141:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269752064:0@lo:400:kworker.0 00010000:00010000:3.0:1790656500.449244:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656500.476206:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656500.476254:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248748928 00000100:00100000:1.0:1790656500.476256:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656500.476266:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248748928 00000100:00100000:2.0:1790656500.476326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1790656500.476337:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248748928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656500.476405:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248748928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656500.476412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:3.0:1790656500.476483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749056 00000100:00100000:3.0:1790656500.476488:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749056 00000100:00100000:3.0:1790656500.476534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1790656500.476542:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248749056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656500.476585:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248749056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656500.476611:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00080000:2.0:1790656500.476673:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656501.410885:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656501.410911:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790656501.411269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656501.413175:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752576 00000100:00100000:2.0:1790656501.413189:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752576 00000100:00100000:2.0:1790656501.413328:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790656501.413339:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269752576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656501.413375:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656501.413465:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269752576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656501.413471:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1790656501.415701:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47b80 x1877639269752576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656501.415741:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269752576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656501.418361:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656501.470751:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656502.501056:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656503.518815:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656504.543282:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656504.990942:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269752704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656504.991019:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656504.992574:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752704 00000100:00100000:3.0:1790656504.992583:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752704 00000100:00100000:3.0:1790656504.992650:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656504.992659:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269752704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656504.992691:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656504.992701:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269753088:0@lo:400:kworker.0 00000100:00100000:1.0:1790656504.992736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656504.992743:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269752704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656504.992750:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656504.992792:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269753216:0@lo:400:kworker.0 00000100:00100000:3.0:1790656504.992819:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790656504.992856:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5ca80 x1877639269752704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656504.992882:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269752704:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790656504.992903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790656504.992915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753088 00000100:00100000:3.0:1790656504.992919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753088 00000100:00100000:3.0:1790656504.992954:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656504.992961:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269753088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.992973:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269752960:0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.992997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656504.993002:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269753088:12345-0@lo:400:kworker.0 Request processed in 42us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656504.993008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656504.993019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752960 00000100:00100000:3.0:1790656504.993022:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752960 00000100:00100000:0.0:1790656504.993024:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790656504.993030:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269752832:0@lo:400:kworker.0 00000100:00100000:3.0:1790656504.993053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790656504.993054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656504.993059:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269752960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.993078:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269753344:0@lo:400:kworker.0 00000100:00100000:3.0:1790656504.993084:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269752960:12345-0@lo:400:kworker.0 Request processed in 26us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656504.993089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790656504.993096:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656504.993099:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753344 00000100:00100000:3.0:1790656504.993102:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753344 00000100:00100000:0.0:1790656504.993112:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269752960:0@lo:400:kworker.0 00000100:00100000:3.0:1790656504.993116:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790656504.993121:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.993137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269752832 00000100:00100000:0.0:1790656504.993140:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269752832 00000100:00100000:3.0:1790656504.993150:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269753344:12345-0@lo:400:kworker.0 Request processed in 29us (53us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656504.993156:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790656504.993162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790656504.993168:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269752832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.993209:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269752832:12345-0@lo:400:kworker.0 Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656504.993282:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753216 00000100:00100000:2.0:1790656504.993286:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753216 00000100:00100000:2.0:1790656504.993327:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790656504.993335:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269753216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656504.993373:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269753216:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656504.993379:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790656504.993391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656504.993395:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790656504.993406:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393f9e2a00 x1877639269753216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656504.993407:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269753088:0@lo:400:kworker.0 00000100:00100000:2.0:1790656504.993415:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269753216:0@lo:400:kworker.0 00000100:00100000:1.0:1790656504.993434:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269752832:0@lo:400:kworker.0 00000100:00100000:1.0:1790656504.993443:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269753344:0@lo:400:kworker.0 00000100:00100000:0.0:1790656504.993486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00010000:3.0:1790656505.568132:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656505.596905:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656505.596955:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656505.597003:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749184 00000100:00100000:1.0:1790656505.597003:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749312 00000100:00100000:3.0:1790656505.597013:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749184 00000100:00100000:1.0:1790656505.597013:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749312 00000100:00100000:3.0:1790656505.597065:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:1.0:1790656505.597079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1790656505.597088:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248749184:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656505.597090:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248749312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656505.597165:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248749312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656505.597173:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00080000:1.0:1790656505.597195:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656505.597253:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248749184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656505.597261:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:1.0:1790656506.527112:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269753472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656506.527187:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656506.527281:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753472 00000100:00100000:2.0:1790656506.527290:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753472 00000100:00080000:1.0:1790656506.527347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656506.527358:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790656506.527368:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269753472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656506.527402:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656506.527454:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269753472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656506.527461:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790656506.527485:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a46300 x1877639269753472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656506.527504:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269753472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656506.592334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656507.616982:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656508.639809:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656509.667808:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656510.111300:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269753856:0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.111367:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656510.111441:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656510.111447:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269753984:0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.111472:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656510.111509:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753984 00000100:00100000:0.0:1790656510.111516:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753984 00000100:00100000:0.0:1790656510.111568:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790656510.111576:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.111664:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269753984:12345-0@lo:400:kworker.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656510.111779:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790656510.111802:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790656510.111845:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a44a80 x1877639269753984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656510.111858:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269753984:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112011:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269753600:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656510.112082:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269754112:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656510.112155:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790656510.112162:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269753728:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656510.112200:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269754240:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112218:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656510.112245:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753856 00000100:00100000:1.0:1790656510.112250:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753856 00000100:00100000:1.0:1790656510.112283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754112 00000100:00100000:1.0:1790656510.112286:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754112 00000100:00100000:1.0:1790656510.112300:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753728 00000100:00100000:1.0:1790656510.112303:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753728 00000100:00100000:1.0:1790656510.112316:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790656510.112322:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269753856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112367:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269753856:12345-0@lo:400:kworker.0 Request processed in 45us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656510.112374:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790656510.112387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790656510.112393:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269754112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112422:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269754112:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656510.112428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790656510.112440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790656510.112446:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269753728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112470:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269753728:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656510.112476:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790656510.112512:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269753728:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.112523:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269754112:0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.113063:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269753600 00000100:00100000:0.0:1790656510.113070:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269753600 00000100:00100000:0.0:1790656510.113115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790656510.113123:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.113183:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269753600:12345-0@lo:400:kworker.0 Request processed in 62us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656510.113190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1790656510.113216:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656510.113237:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269753600:0@lo:400:kworker.0 00000100:00100000:0.0:1790656510.113262:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269753856:0@lo:400:kworker.0 00000100:00100000:2.0:1790656510.113377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754240 00000100:00100000:2.0:1790656510.113382:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754240 00000100:00100000:2.0:1790656510.113427:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790656510.113434:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269754240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656510.113475:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269754240:12345-0@lo:400:kworker.0 Request processed in 42us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656510.113492:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790656510.113526:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47100 x1877639269754240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656510.113536:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269754240:0@lo:400:kworker.0 00000100:00100000:1.0:1790656510.113710:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656510.113720:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269754368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656510.113752:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656510.113891:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754368 00000100:00100000:2.0:1790656510.113896:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754368 00000100:00100000:2.0:1790656510.113939:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790656510.113947:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269754368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656510.113974:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656510.114012:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269754368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656510.114018:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790656510.114044:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47ce00 x1877639269754368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656510.114058:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269754368:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790656510.114323:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790656510.689656:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656510.718198:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656510.718312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656510.718340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749568 00000100:00100000:3.0:1790656510.718349:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749568 00000100:00100000:3.0:1790656510.718428:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1790656510.718439:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248749568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656510.718508:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248749568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656510.718514:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00080000:2.0:1790656510.718809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656510.719352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749440 00000100:00100000:0.0:1790656510.719358:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749440 00000100:00100000:0.0:1790656510.719492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1790656510.719501:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248749440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656510.719552:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248749440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 52us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656510.719558:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00000001:02000400:2.0:1790656510.981454:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:35:08 (1790656508) === 00000100:00100000:3.0:1790656511.413236:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.413334:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749696 00000100:00100000:2.0:1790656511.413344:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749696 00000100:00100000:2.0:1790656511.413405:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:2.0:1790656511.413416:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:8116:x1877639248749696:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790656511.413432:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656511.413449:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481a00/0x9c3a6e82066eab98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a23764a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.413492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481a00/0x9c3a6e82066eab98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23764a expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.413504:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481a00/0x9c3a6e82066eab98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23764a expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.413513:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481a00, rc 0) 00000100:00100000:2.0:1790656511.413567:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248749696:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 153us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.413575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:3.0:1790656511.423842:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656511.423949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749824 00000100:00100000:0.0:1790656511.423960:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749824 00000100:00100000:0.0:1790656511.424017:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:0.0:1790656511.424026:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248749824:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790656511.424324:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248749824:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 298us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656511.424332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:3.0:1790656511.436661:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656511.436796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248749952 00000100:00100000:0.0:1790656511.436806:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248749952 00000100:00100000:0.0:1790656511.436859:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:0.0:1790656511.436869:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248749952:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790656511.437090:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248749952:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 222us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656511.437098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:3.0:1790656511.448158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.448403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750080 00000100:00100000:2.0:1790656511.448412:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750080 00000100:00100000:2.0:1790656511.448465:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:2.0:1790656511.448474:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8120:x1877639248750080:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656511.448774:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8120:x1877639248750080:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 299us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.448782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:1.0:1790656511.473164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.473458:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750208 00000100:00100000:3.0:1790656511.473472:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750208 00000100:00100000:3.0:1790656511.473546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:3.0:1790656511.473559:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8120:x1877639248750208:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790656511.473994:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8120:x1877639248750208:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 433us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656511.474011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:3.0:1790656511.489628:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656511.489761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750336 00000100:00100000:0.0:1790656511.489774:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750336 00000100:00100000:0.0:1790656511.489845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:0.0:1790656511.489857:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:8116:x1877639248750336:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656511.489878:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656511.489901:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900031000/0x9c3a6e82066eab9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237674 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656511.489946:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900031000/0x9c3a6e82066eab9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237674 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656511.489958:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900031000/0x9c3a6e82066eab9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237674 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656511.489968:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031000, rc 0) 00000100:00100000:0.0:1790656511.490044:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:8116:x1877639248750336:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 188us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656511.490068:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:1.0:1790656511.497644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.497901:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750464 00000100:00100000:2.0:1790656511.497913:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750464 00000100:00100000:2.0:1790656511.497996:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:2.0:1790656511.498009:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:8116:x1877639248750464:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790656511.498043:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790656511.498077:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790656511.498081:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790656511.498085:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790656511.498087:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790656511.507070:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:8116:x1877639248750464:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 9047us (9424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.507089:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:0.0:1790656511.513130:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.513423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750592 00000100:00100000:2.0:1790656511.513437:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750592 00000100:00100000:2.0:1790656511.513512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:2.0:1790656511.513524:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:8116:x1877639248750592:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790656511.513552:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656511.513577:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a23767b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.513640:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.513653:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656511.513663:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656511.513743:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8116:x1877639248750592:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 219us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.513759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:1.0:1790656511.518929:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.519347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750720 00000100:00100000:2.0:1790656511.519362:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750720 00000100:00100000:2.0:1790656511.519492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:2.0:1790656511.519504:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8116:x1877639248750720:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790656511.519961:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8116:x1877639248750720:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 457us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.519982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:1.0:1790656511.522715:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656511.523618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750848 00000100:00100000:0.0:1790656511.523633:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750848 00000100:00100000:0.0:1790656511.523694:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1790656511.523705:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8116:x1877639248750848:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790656511.524414:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8116:x1877639248750848:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 705us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656511.524425:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:1.0:1790656511.529698:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.529941:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248750976 00000100:00100000:2.0:1790656511.529955:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248750976 00000100:00100000:2.0:1790656511.530073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:2.0:1790656511.530087:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8123:x1877639248750976:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656511.530451:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8123:x1877639248750976:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 365us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.530459:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:2.0:1790656511.543011:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.543130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751104 00000100:00100000:3.0:1790656511.543144:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751104 00000100:00100000:3.0:1790656511.543215:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:3.0:1790656511.543432:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8123:x1877639248751104:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790656511.543808:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:8123:x1877639248751104:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 380us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656511.549032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:3.0:1790656511.553494:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.553652:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751232 00000100:00100000:2.0:1790656511.553665:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751232 00000100:00100000:2.0:1790656511.553726:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656511.553736:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2338:x1877639248751232:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790656511.553774:0:6714:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f328cd36-3190-45c6-abbe-cee7addf32ed@192.168.203.23@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1790656511.553819:0:6714:0:(genops.c:1384:class_connect()) connect: client f328cd36-3190-45c6-abbe-cee7addf32ed, cookie 0x9c3a6e82066eabad 00000004:00100000:2.0:1790656511.553858:0:6714:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790656511.554507:0:6714:0:(import.c:65:import_set_state_nolock()) ffff94390a3a6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656511.554636:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2338:x1877639248751232:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 899us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.554645:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1790656511.559048:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656511.559218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751616 00000100:00100000:1.0:1790656511.559233:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751616 00000100:00100000:1.0:1790656511.559311:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:1.0:1790656511.559324:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248751616:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656511.559433:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248751616:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656511.559442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1790656511.565318:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.565379:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.565484:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751488 00000100:00100000:0.0:1790656511.565484:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751360 00000100:00100000:2.0:1790656511.565496:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751488 00000100:00100000:0.0:1790656511.565496:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751360 00000100:00100000:2.0:1790656511.565581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00080000:1.0:1790656511.565620:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656511.565628:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+7:8116:x1877639248751488:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790656511.565692:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790656511.565834:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+7:8116:x1877639248751488:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 240us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.565843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1790656511.565851:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656511.565860:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+6:0:x1877639248751360:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790656511.565875:0:6714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790656511.565910:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+6:0:x1877639248751360:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 52us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656511.565926:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656511.568565:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656511.569004:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751744 00000100:00100000:2.0:1790656511.569019:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751744 00000100:00100000:2.0:1790656511.569132:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1790656511.569144:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+6:8116:x1877639248751744:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790656511.569260:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+6:8116:x1877639248751744:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 118us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.569269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1790656511.571772:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.572012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752128 00000100:00100000:3.0:1790656511.572025:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752128 00000100:00100000:3.0:1790656511.572102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656511.572114:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+6:8116:x1877639248752128:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790656511.572218:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790656511.572321:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+6:8116:x1877639248752128:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 208us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656511.572329:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656511.574015:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.574064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656511.574099:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248751872 00000100:00100000:3.0:1790656511.574110:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248751872 00000100:00100000:3.0:1790656511.574172:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752000 00000100:00100000:3.0:1790656511.574175:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752000 00000100:00100000:3.0:1790656511.574195:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1790656511.574205:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2338:x1877639248751872:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790656511.574249:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f328cd36-3190-45c6-abbe-cee7addf32ed@192.168.203.23@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1790656511.574290:0:6691:0:(genops.c:1384:class_connect()) connect: client f328cd36-3190-45c6-abbe-cee7addf32ed, cookie 0x9c3a6e82066eabb4 00002000:00100000:3.0:1790656511.574304:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f328cd36-3190-45c6-abbe-cee7addf32ed/ffff94391f583800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790656511.574335:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1790656511.575550:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1790656511.575561:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2338:x1877639248752000:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790656511.575612:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f328cd36-3190-45c6-abbe-cee7addf32ed@192.168.203.23@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1790656511.575650:0:6692:0:(genops.c:1384:class_connect()) connect: client f328cd36-3190-45c6-abbe-cee7addf32ed, cookie 0x9c3a6e82066eabbb 00002000:00100000:2.0:1790656511.575662:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f328cd36-3190-45c6-abbe-cee7addf32ed/ffff94393b806000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790656511.575673:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790656511.575864:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790656511.575911:0:6691:0:(import.c:65:import_set_state_nolock()) ffff94391f586000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656511.576019:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2338:x1877639248751872:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1813us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656511.576027:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00002000:00080000:2.0:1790656511.576346:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790656511.576367:0:6692:0:(import.c:65:import_set_state_nolock()) ffff94380266c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656511.576395:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2338:x1877639248752000:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 834us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.576402:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1790656511.647086:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269754496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656511.647366:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656511.647514:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754496 00000100:00100000:2.0:1790656511.647525:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754496 00000100:00100000:2.0:1790656511.647637:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790656511.647650:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269754496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656511.647716:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656511.647793:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269754496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656511.647801:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1790656511.648670:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47100 x1877639269754496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656511.648708:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269754496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656511.710871:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656512.734843:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790656513.227936:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00010000:00010000:3.0:1790656513.758819:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790656514.787900:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00010000:00010000:3.0:1790656514.791859:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790656514.810996:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00000100:00100000:3.0:1790656515.230953:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269754880:0@lo:400:kworker.0 00000100:00100000:3.0:1790656515.231031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231191:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269754752:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231222:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231262:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269755264:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231312:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790656515.231320:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269754624:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231395:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269755136:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231415:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231448:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754880 00000100:00100000:0.0:1790656515.231455:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754880 00000100:00100000:0.0:1790656515.231503:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754752 00000100:00100000:0.0:1790656515.231506:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754752 00000100:00100000:0.0:1790656515.231518:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755136 00000100:00100000:0.0:1790656515.231520:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755136 00000100:00100000:0.0:1790656515.231534:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790656515.231542:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269754880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231588:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269754880:12345-0@lo:400:kworker.0 Request processed in 46us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656515.231615:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790656515.231633:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790656515.231638:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231669:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269754752:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656515.231675:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790656515.231685:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790656515.231690:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231714:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269755136:12345-0@lo:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656515.231719:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1790656515.231735:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656515.231767:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269755136:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231789:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269754752:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231835:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269755008:0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231859:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656515.231909:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755264 00000100:00100000:0.0:1790656515.231913:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755264 00000100:00100000:0.0:1790656515.231938:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755008 00000100:00100000:0.0:1790656515.231942:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755008 00000100:00100000:0.0:1790656515.231958:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790656515.231964:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269755264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.231997:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269755264:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656515.232003:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790656515.232014:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790656515.232020:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269755008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656515.232049:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269755008:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656515.232055:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790656515.232071:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656515.232074:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790656515.232090:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5c700 x1877639269755008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656515.232111:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269755008:0@lo:400:kworker.0 00010000:00080000:0.0:1790656515.232134:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943802a5d180 x1877639269755264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656515.232143:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269755264:0@lo:400:kworker.0 00000100:00100000:2.0:1790656515.232356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269754624 00000100:00100000:2.0:1790656515.232361:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269754624 00000100:00100000:2.0:1790656515.232393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790656515.232400:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656515.232436:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269754624:12345-0@lo:400:kworker.0 Request processed in 37us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656515.232443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790656515.232480:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269754624:0@lo:400:kworker.0 00000100:00100000:3.0:1790656515.232666:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269754880:0@lo:400:kworker.0 00000100:00100000:3.0:1790656515.236471:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269755392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656515.236558:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656515.237443:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755392 00000100:00100000:1.0:1790656515.237453:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755392 00000100:00100000:1.0:1790656515.237510:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790656515.237519:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269755392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656515.237554:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656515.237642:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269755392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656515.237649:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790656515.238109:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f47df80 x1877639269755392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656515.238130:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269755392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790656515.806913:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790656516.608166:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1790656516.767053:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269755520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790656516.767122:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656516.767304:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755520 00000100:00100000:2.0:1790656516.767312:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755520 00000100:00100000:2.0:1790656516.767369:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790656516.767379:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269755520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656516.767425:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656516.767474:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269755520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656516.767481:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1790656516.767846:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a47100 x1877639269755520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656516.767865:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269755520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656516.830892:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656516.862306:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656516.862349:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656516.862412:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656516.862444:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656516.862469:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656516.862497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752384 00000100:00100000:3.0:1790656516.862506:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752384 00000100:00100000:3.0:1790656516.862561:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752512 00000100:00100000:3.0:1790656516.862564:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752512 00000100:00100000:3.0:1790656516.862586:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1790656516.862623:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248752384:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656516.862690:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248752384:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656516.862698:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1790656516.862722:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1790656516.862729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248752512:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656516.862752:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248752512:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656516.862758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1790656516.862774:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752640 00000100:00100000:3.0:1790656516.862778:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752640 00000100:00100000:3.0:1790656516.862801:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752768 00000100:00100000:3.0:1790656516.862805:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752768 00000100:00100000:3.0:1790656516.862824:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1790656516.862830:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248752640:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656516.862856:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248752640:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656516.862862:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1790656516.862887:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1790656516.862896:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248752768:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656516.862901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752256 00000100:00100000:0.0:1790656516.862908:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752256 00000100:00100000:3.0:1790656516.862924:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248752768:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656516.862931:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1790656516.862945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:0.0:1790656516.862955:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248752256:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1790656516.862962:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656516.862967:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656516.862970:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656516.862989:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248752256:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656516.862996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 217 00010000:00010000:3.0:1790656517.854797:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656518.882214:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656519.905182:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656520.351722:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269755776:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.351783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.351834:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269756288:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.351873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.351919:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790656520.351925:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269755648:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.351950:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.351972:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269756160:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.351992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.352029:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269756032:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.352070:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656520.352076:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269755904:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656520.352119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755776 00000100:00100000:2.0:1790656520.352127:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755776 00000100:00100000:2.0:1790656520.352391:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756160 00000100:00100000:2.0:1790656520.352396:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756160 00000100:00100000:2.0:1790656520.352422:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755904 00000100:00100000:2.0:1790656520.352425:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755904 00000100:00100000:2.0:1790656520.352442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790656520.352449:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269755776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352502:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269755776:12345-0@lo:400:kworker.0 Request processed in 53us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.352508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790656520.352524:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790656520.352529:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269756160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352553:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269756160:12345-0@lo:400:kworker.0 Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.352569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790656520.352580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790656520.352586:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269755904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352639:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269755904:12345-0@lo:400:kworker.0 Request processed in 53us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.352645:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790656520.352666:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756288 00000100:00100000:2.0:1790656520.352669:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756288 00000100:00100000:2.0:1790656520.352693:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756032 00000100:00100000:2.0:1790656520.352696:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756032 00000100:00100000:2.0:1790656520.352716:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790656520.352721:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269756288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352750:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269756288:12345-0@lo:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.352755:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790656520.352765:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790656520.352770:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269756032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352797:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269756032:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.352803:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790656520.352818:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269755648 00000100:00100000:2.0:1790656520.352822:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269755648 00000100:00100000:2.0:1790656520.352846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790656520.352863:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269755648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.352893:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269755648:12345-0@lo:400:kworker.0 Request processed in 40us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656520.354239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1790656520.354380:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656520.354385:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656520.354388:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656520.354438:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269755904:0@lo:400:kworker.0 00010000:00080000:2.0:1790656520.354455:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a45880 x1877639269756032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656520.354466:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269756032:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.354499:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269755648:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.354510:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269756160:0@lo:400:kworker.0 00000100:00100000:2.0:1790656520.354519:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269755776:0@lo:400:kworker.0 00010000:00080000:2.0:1790656520.354530:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a46300 x1877639269756288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656520.354538:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269756288:0@lo:400:kworker.0 00000100:00100000:3.0:1790656520.359683:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790656520.359707:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269756416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656520.359784:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656520.359885:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756416 00000100:00100000:0.0:1790656520.359902:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756416 00000100:00100000:0.0:1790656520.359962:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790656520.359972:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269756416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656520.360006:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656520.360071:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269756416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656520.360078:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790656520.360326:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b979f80 x1877639269756416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656520.360346:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269756416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790656520.926815:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656521.888616:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656521.888638:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269756544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656521.888706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656521.888890:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756544 00000100:00100000:2.0:1790656521.888898:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756544 00000100:00100000:2.0:1790656521.888961:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790656521.888971:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269756544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656521.889002:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656521.889816:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269756544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 844us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656521.889824:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1790656521.889918:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a46300 x1877639269756544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656521.889937:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269756544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656521.951680:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656521.982984:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656521.983039:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656521.983069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656521.983072:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248752896 00000100:00100000:1.0:1790656521.983082:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248752896 00000100:00100000:3.0:1790656521.983089:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656521.983116:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656521.983134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:1.0:1790656521.983144:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248752896:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656521.983154:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753408 00000100:00100000:3.0:1790656521.983160:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753408 00000100:00100000:3.0:1790656521.983204:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753280 00000100:00100000:3.0:1790656521.983208:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753280 00000100:00100000:1.0:1790656521.983228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248752896:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656521.983235:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1790656521.983239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:3.0:1790656521.983249:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753408:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656521.983284:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753408:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 39us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656521.983291:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1790656521.983305:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1790656521.983312:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753280:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656521.983333:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753280:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656521.983338:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1790656521.983355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753152 00000100:00100000:3.0:1790656521.983365:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753152 00000100:00100000:3.0:1790656521.983406:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753024 00000100:00100000:3.0:1790656521.983409:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753024 00000100:00100000:3.0:1790656521.983432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1790656521.983439:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753152:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656521.983468:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248753152:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656521.983474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1790656521.983486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1790656521.983492:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248753024:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656521.983513:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248753024:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656521.983518:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00080000:3.0:1790656521.983537:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656521.983542:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656521.983543:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790656522.974767:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656524.000882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656525.023266:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656525.471585:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269756672:0@lo:400:kworker.0 00000100:00100000:0.0:1790656525.471675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656525.472143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756672 00000100:00100000:2.0:1790656525.472151:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756672 00000100:00100000:2.0:1790656525.472196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790656525.472205:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269756672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656525.472704:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269756800:0@lo:400:kworker.0 00000100:00100000:3.0:1790656525.472740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656525.472778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756800 00000100:00100000:3.0:1790656525.472783:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756800 00000100:00100000:3.0:1790656525.472811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790656525.472831:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269756800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656525.472868:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269756800:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656525.472875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790656525.472927:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269756800:0@lo:400:kworker.0 00000100:00100000:3.0:1790656525.473105:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269756928:0@lo:400:kworker.0 00000100:00100000:3.0:1790656525.473141:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656525.473396:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269756672:12345-0@lo:400:kworker.0 Request processed in 1190us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656525.473404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790656525.473451:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269757056:0@lo:400:kworker.0 00000100:00100000:2.0:1790656525.473477:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656525.473506:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269756928 00000100:00100000:2.0:1790656525.473511:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269756928 00000100:00100000:2.0:1790656525.473544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790656525.473552:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269756928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656525.473655:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269756672:0@lo:400:kworker.0 00000100:00100000:0.0:1790656525.473712:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656525.473718:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269757184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656525.473745:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656525.473777:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757184 00000100:00100000:0.0:1790656525.473781:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757184 00000100:00100000:0.0:1790656525.473809:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790656525.473828:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269757184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656525.473855:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656525.473891:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269757184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656525.473898:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790656525.473939:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b979180 x1877639269757184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656525.473955:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269757184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656525.474013:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757056 00000100:00100000:0.0:1790656525.474017:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757056 00000100:00100000:0.0:1790656525.474045:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790656525.474052:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269757056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656525.474087:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269757056:12345-0@lo:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656525.474409:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790656525.474443:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656525.474447:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656525.474450:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656525.474577:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656525.474587:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269757312:0@lo:400:kworker.0 00000100:00100000:1.0:1790656525.474640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656525.474669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757312 00000100:00100000:1.0:1790656525.474672:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757312 00000100:00100000:1.0:1790656525.474703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790656525.474709:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269757312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656525.474743:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269757312:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656525.474748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790656525.474762:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656525.474781:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269757312:0@lo:400:kworker.0 00010000:00080000:1.0:1790656525.474825:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b2680 x1877639269757056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656525.474834:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269757056:0@lo:400:kworker.0 00000100:00100000:2.0:1790656525.475084:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269756928:12345-0@lo:400:kworker.0 Request processed in 1533us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656525.475212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790656525.475282:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269756928:0@lo:400:kworker.0 00010000:00010000:2.0:1790656526.063251:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656527.014375:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269757440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790656527.014482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656527.014546:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757440 00000100:00100000:1.0:1790656527.014562:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757440 00000100:00100000:1.0:1790656527.014654:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790656527.014666:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269757440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656527.014700:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656527.014758:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269757440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656527.014765:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1790656527.014879:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a44a80 x1877639269757440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656527.014899:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269757440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790656527.015125:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790656527.070879:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656527.116759:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656527.116812:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656527.116844:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656527.116878:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656527.116903:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656527.116929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753792 00000100:00100000:3.0:1790656527.116939:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753792 00000100:00100000:3.0:1790656527.117003:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753664 00000100:00100000:3.0:1790656527.117006:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753664 00000100:00100000:3.0:1790656527.117030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:3.0:1790656527.117039:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248753792:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656527.117101:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248753792:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656527.117109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:0.0:1790656527.117267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:0.0:1790656527.117276:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248753664:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656527.117317:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248753664:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656527.117323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1790656527.117400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753536 00000100:00100000:2.0:1790656527.117405:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753536 00000100:00100000:2.0:1790656527.117441:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:2.0:1790656527.117449:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248753536:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656527.117473:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248753536:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656527.117478:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00080000:2.0:1790656527.117520:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656527.117540:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754048 00000100:00100000:2.0:1790656527.117544:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754048 00000100:00100000:2.0:1790656527.117572:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248753920 00000100:00100000:2.0:1790656527.117575:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248753920 00000100:00100000:2.0:1790656527.117620:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656527.117627:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248754048:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656527.117652:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248754048:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656527.117658:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656527.117671:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1790656527.117677:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248753920:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656527.117698:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248753920:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656527.117704:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00080000:2.0:1790656527.117717:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656527.117719:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790656528.099659:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656529.123086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656530.148283:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656530.590822:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269757568:0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.590895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656530.590936:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269757696:0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.590967:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269758080:0@lo:400:kworker.0 00000100:00100000:2.0:1790656530.590969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656530.590989:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269758208:0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.590989:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656530.591010:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656530.591014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656530.591015:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269757952:0@lo:400:kworker.0 00000100:00100000:3.0:1790656530.591073:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757568 00000100:00100000:3.0:1790656530.591091:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757568 00000100:00100000:3.0:1790656530.591141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790656530.591150:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656530.591258:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269757824:0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.593153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656530.593244:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757696 00000100:00100000:1.0:1790656530.593253:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757696 00000100:00100000:1.0:1790656530.593304:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758080 00000100:00100000:1.0:1790656530.593307:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758080 00000100:00100000:1.0:1790656530.593613:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790656530.593623:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269757696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.593684:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269757696:12345-0@lo:400:kworker.0 Request processed in 62us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656530.593692:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790656530.593709:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790656530.593715:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269758080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.593745:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269758080:12345-0@lo:400:kworker.0 Request processed in 30us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656530.593764:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790656530.593797:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758208 00000100:00100000:1.0:1790656530.593802:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758208 00000100:00100000:1.0:1790656530.593828:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757952 00000100:00100000:1.0:1790656530.593830:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757952 00000100:00100000:1.0:1790656530.593847:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656530.593853:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943909793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269758208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.593886:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943909793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269758208:12345-0@lo:400:kworker.0 Request processed in 34us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656530.593892:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656530.594130:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790656530.594137:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.594166:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269757952:12345-0@lo:400:kworker.0 Request processed in 29us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656530.594172:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1790656530.594192:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656530.594196:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656530.594406:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790656530.594449:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94390977f480 x1877639269757952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656530.594464:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269757952:0@lo:400:kworker.0 00000100:00100000:1.0:1790656530.594476:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269758080:0@lo:400:kworker.0 00000100:00100000:3.0:1790656530.594820:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269757568:12345-0@lo:400:kworker.0 Request processed in 3669us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656530.594828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790656530.594942:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269757568:0@lo:400:kworker.0 00000100:00100000:0.0:1790656530.594973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656530.595015:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269758336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656530.595042:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269757824 00000100:00100000:3.0:1790656530.595047:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269757824 00000100:00100000:0.0:1790656530.595057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656530.595081:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758336 00000100:00100000:0.0:1790656530.595085:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758336 00000100:00100000:3.0:1790656530.595094:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790656530.595100:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269757824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656530.595110:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790656530.595115:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269758336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656530.595132:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269757824:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656530.595137:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00002000:00000024:0.0:1790656530.595140:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790656530.595153:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656530.595170:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269758336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656530.595176:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790656530.595250:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b1c00 x1877639269758336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656530.595265:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269758336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656530.595276:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269757824:0@lo:400:kworker.0 00010000:00080000:3.0:1790656530.598502:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94390977dc00 x1877639269758208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656530.598521:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269758208:0@lo:400:kworker.0 00000100:00100000:3.0:1790656530.598560:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269757696:0@lo:400:kworker.0 00010000:00010000:2.0:1790656531.171903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656532.131846:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656532.131868:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269758464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656532.131959:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656532.132069:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758464 00000100:00100000:2.0:1790656532.132078:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758464 00000100:00100000:2.0:1790656532.132161:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790656532.132172:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269758464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656532.132205:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790656532.132219:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656532.132274:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269758464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656532.132282:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1790656532.132624:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935a45880 x1877639269758464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656532.132644:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269758464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656532.190744:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656532.237836:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656532.237921:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656532.237951:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656532.237982:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656532.238018:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656532.238297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754432 00000100:00100000:3.0:1790656532.238317:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754432 00000100:00100000:3.0:1790656532.238379:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754304 00000100:00100000:3.0:1790656532.238382:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754304 00000100:00100000:3.0:1790656532.238406:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1790656532.238416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248754432:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656532.238487:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248754432:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 72us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656532.238494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1790656532.238510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1790656532.238517:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248754304:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656532.238553:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248754304:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656532.238560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00080000:2.0:1790656532.241342:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656532.242829:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754560 00000100:00100000:1.0:1790656532.242845:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754560 00000100:00100000:1.0:1790656532.242917:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754688 00000100:00100000:1.0:1790656532.242921:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754688 00000100:00100000:1.0:1790656532.242951:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1790656532.242961:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2338:x1877639248754560:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:1.0:1790656532.242990:0:8825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eabb4 00000100:00080000:1.0:1790656532.242999:0:8825:0:(import.c:65:import_set_state_nolock()) ffff94391f586000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790656532.243038:0:8825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790656532.243497:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+2:2338:x1877639248754560:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 536us (5512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656532.243505:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1790656532.243521:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1790656532.243528:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2338:x1877639248754688:12345-192.168.203.23@tcp:9:kworker.0 00000100:00100000:0.0:1790656532.244268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754176 00000100:00100000:0.0:1790656532.244275:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754176 00000100:00100000:0.0:1790656532.244317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:0.0:1790656532.244327:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248754176:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656532.244363:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248754176:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 38us (6536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656532.244376:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00010000:00010000:0.0:1790656532.244445:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790656532.244648:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656532.244654:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1790656532.246951:0:8825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eabbb 00000100:00080000:1.0:1790656532.246971:0:8825:0:(import.c:65:import_set_state_nolock()) ffff94380266c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790656532.247022:0:8825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790656532.247362:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+2:2338:x1877639248754688:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 3830us (9339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656532.247373:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:3.0:1790656532.248567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790656532.606872:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790656533.214940:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790656533.725293:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00000020:00000080:0.0:1790656533.725302:0:6716:0:(genops.c:885:class_export_put()) final put ffff94391f583800/f328cd36-3190-45c6-abbe-cee7addf32ed 00000020:00000080:2.0:1790656533.725361:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94391f583800/f328cd36-3190-45c6-abbe-cee7addf32ed for lustre-OST0000 00000020:00000080:2.0:1790656533.725408:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94391f586000 for lustre-OST0000 00010000:00010000:3.0:1790656534.246912:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790656535.255421:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00000020:00000080:3.0:1790656535.255431:0:7645:0:(genops.c:885:class_export_put()) final put ffff94393b806000/f328cd36-3190-45c6-abbe-cee7addf32ed 00000020:00000080:3.0:1790656535.255462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94393b806000/f328cd36-3190-45c6-abbe-cee7addf32ed for lustre-OST0001 00000020:00000080:3.0:1790656535.255502:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94380266c000 for lustre-OST0001 00010000:00010000:0.0:1790656535.266695:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656535.711162:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269758592:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711388:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711447:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269759104:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711511:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656535.711518:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269758976:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711576:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269758720:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711639:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269759232:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711681:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656535.711687:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269758848:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.711762:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758592 00000100:00100000:1.0:1790656535.711769:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758592 00000100:00100000:1.0:1790656535.711813:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790656535.711823:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269758592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.711869:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269758592:12345-0@lo:400:kworker.0 Request processed in 47us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.711877:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790656535.711908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759104 00000100:00100000:1.0:1790656535.711912:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759104 00000100:00100000:1.0:1790656535.713585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758720 00000100:00100000:1.0:1790656535.713607:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758720 00000100:00100000:1.0:1790656535.713625:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758848 00000100:00100000:1.0:1790656535.713628:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758848 00000100:00100000:1.0:1790656535.713646:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790656535.713655:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269759104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.713734:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269759104:12345-0@lo:400:kworker.0 Request processed in 80us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.713752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790656535.713776:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790656535.713782:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269758720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.713820:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269758720:12345-0@lo:400:kworker.0 Request processed in 38us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.713826:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790656535.713837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790656535.713843:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.713870:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269758848:12345-0@lo:400:kworker.0 Request processed in 27us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.713875:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790656535.713899:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269758976 00000100:00100000:1.0:1790656535.713902:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269758976 00000100:00100000:1.0:1790656535.714342:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759232 00000100:00100000:1.0:1790656535.714346:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759232 00000100:00100000:1.0:1790656535.714370:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790656535.714377:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.714409:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269758976:12345-0@lo:400:kworker.0 Request processed in 33us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.714810:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790656535.714824:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790656535.714831:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.714863:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269759232:12345-0@lo:400:kworker.0 Request processed in 33us (3200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.714869:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1790656535.714903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656535.714908:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656535.714910:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656535.715118:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269758848:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.715136:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269758720:0@lo:400:kworker.0 00010000:00080000:1.0:1790656535.715149:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b0000 x1877639269759232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656535.715160:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269759232:0@lo:400:kworker.0 00010000:00080000:1.0:1790656535.715201:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b2300 x1877639269758976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656535.715210:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269758976:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.715294:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269758592:0@lo:400:kworker.0 00000100:00100000:1.0:1790656535.715306:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269759104:0@lo:400:kworker.0 00000100:00100000:2.0:1790656535.719354:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656535.719377:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269759360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656535.719451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656535.719688:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759360 00000100:00100000:1.0:1790656535.719696:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759360 00000100:00100000:1.0:1790656535.719767:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790656535.719776:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269759360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656535.719813:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656535.719862:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269759360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656535.719868:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1790656535.719905:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b1f80 x1877639269759360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656535.719933:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269759360:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1790656535.948232:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9c530510 20000000:00000080:1.0:1790656535.948247:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94393bd39000 uarg=0000000000000000 20000000:01000000:1.0:1790656535.948289:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790656535.948295:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790656535.948299:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790656535.951069:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790656535.955004:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790656535.969509:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790656535.970407:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970429:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970438:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970456:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970463:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970471:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970480:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970520:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970535:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 12 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.970548:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759488:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656535.970684:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.970694:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 18 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.971167:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759616:0@lo:104: 00000100:00100000:3.0:1790656535.971210:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790656535.971252:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.971269:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 18 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.971277:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759744:0@lo:104: 00000100:00100000:3.0:1790656535.971300:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790656535.971324:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.971332:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 18 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.971339:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759872:0@lo:104: 00000100:00100000:3.0:1790656535.971358:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790656535.971377:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.971385:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.971393:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269760000:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656535.971424:0:11168:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656535.972816:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759616 00000100:00100000:2.0:1790656535.972826:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759616 00000100:00100000:2.0:1790656535.972871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759744 00000100:00100000:2.0:1790656535.972874:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759744 00000100:00100000:2.0:1790656535.972895:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269759872 00000100:00100000:2.0:1790656535.972898:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269759872 00000100:00100000:2.0:1790656535.972911:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790656535.972920:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:11168:x1877639269759616:12345-0@lo:104: 00010000:00010000:2.0:1790656535.972934:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973019:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790656535.973025:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:11168:x1877639269759616:12345-0@lo:104: Request processed in 106us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656535.973032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790656535.973061:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790656535.973067:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:11168:x1877639269759744:12345-0@lo:104: 00010000:00010000:2.0:1790656535.973075:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973109:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790656535.973115:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:11168:x1877639269759744:12345-0@lo:104: Request processed in 49us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656535.973121:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790656535.973133:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790656535.973138:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:11168:x1877639269759872:12345-0@lo:104: 00010000:00010000:2.0:1790656535.973144:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973166:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790656535.973170:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:11168:x1877639269759872:12345-0@lo:104: Request processed in 33us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656535.973175:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1790656535.973190:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790656535.973196:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973203:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656535.973206:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973214:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656535.973230:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656535.973234:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790656535.973263:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973269:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656535.973289:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973296:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066eab8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973308:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790656535.973312:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973317:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656535.973320:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973327:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656535.973333:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656535.973339:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790656535.973360:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973366:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656535.973373:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973379:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97200/0x9c3a6e82066eab7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab83 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973389:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656535.973392:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973398:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656535.973401:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973408:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656535.973414:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656535.973419:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790656535.973430:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973436:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656535.973451:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973468:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066eab6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eab75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656535.973482:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656535.973483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656535.973485:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656535.973491:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656535.973502:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269760128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656535.973535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656535.973570:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656535.973576:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269760256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656535.973643:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656535.973671:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269760384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656535.973691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656535.977056:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759616:0@lo:104: 00000100:00100000:3.0:1790656535.977071:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759744:0@lo:104: 00000100:00100000:3.0:1790656535.977080:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759872:0@lo:104: 00000100:00100000:3.0:1790656535.977118:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760128 00000100:00100000:3.0:1790656535.977126:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760128 00010000:00010000:3.0:1790656535.977165:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 19 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.977198:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760256 00000100:00100000:3.0:1790656535.977201:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760256 00010000:00010000:3.0:1790656535.977213:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 20 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.977223:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760384 00000100:00100000:3.0:1790656535.977226:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760384 00010000:00010000:3.0:1790656535.977235:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 21 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.977248:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656535.977256:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392878a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3301:x1877639269760128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656535.977271:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656535.977276:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 21 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977286:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 21 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977303:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96c00/0x9c3a6e82066eab91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eab8a expref: 21 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977318:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656535.977379:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392878a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3301:x1877639269760128:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656535.977386:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656535.977428:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656535.977434:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269760256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656535.977449:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656535.977454:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 19 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977463:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 19 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977473:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c97800/0x9c3a6e82066eab83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eab7c expref: 19 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977482:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656535.977504:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3301:x1877639269760256:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656535.977510:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656535.977522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790656535.977527:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3299:x1877639269760384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656535.977534:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656535.977538:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 17 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977547:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 17 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977557:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96400/0x9c3a6e82066eab75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eab6e expref: 17 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.977565:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656535.984216:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3299:x1877639269760384:12345-0@lo:103:ldlm_bl.0 Request processed in 6679us (10514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656535.984250:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790656535.984465:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269760256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656535.984476:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269760128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656535.984516:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269760384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656535.987226:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656535.987253:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754816 00000100:00100000:3.0:1790656535.987260:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754816 00010000:00010000:3.0:1790656535.987293:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 13 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.987321:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:3.0:1790656535.987329:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248754816:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656535.987341:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656535.987346:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 13 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.987357:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 13 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656535.987377:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656535.987417:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248754816:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656535.987424:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00010000:00010000:1.0:1790656535.987862:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481000/0x9c3a6e82066eaba6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23767b expref: 12 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656535.987875:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269759488:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656535.991276:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877639269760000:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656535.991319:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656535.992333:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656535.992403:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248754944 00000100:00100000:0.0:1790656535.992420:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248754944 00010000:00010000:0.0:1790656535.992455:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656535.992493:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1790656535.992503:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:2342:x1877639248754944:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656535.992517:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656535.992523:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992534:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992553:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96000/0x9c3a6e82066eab67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237643 expref: 12 pid: 5838 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992570:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992579:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992642:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992650:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992657:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992665:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992672:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656535.992676:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.992684:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.993018:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656535.993032:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656535.993079:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2342:x1877639248754944:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 577us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656535.993088:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00010000:00010000:1.0:1790656535.993392:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656535.993402:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656535.993408:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96200/0x9c3a6e82066eabc2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656536.291174:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656537.246843:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269760512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656537.246919:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.247224:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760512 00000100:00100000:3.0:1790656537.247239:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760512 00000100:00100000:3.0:1790656537.247303:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790656537.247314:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269760512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656537.247351:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656537.247402:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269760512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656537.247410:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790656537.247453:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94390977f800 x1877639269760512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656537.247473:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269760512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656537.247745:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790656537.310775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656537.348276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656537.348364:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656537.348400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656537.348779:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755328 00000100:00100000:3.0:1790656537.348789:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755328 00000100:00100000:3.0:1790656537.348856:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755200 00000100:00100000:3.0:1790656537.348859:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755200 00000100:00100000:3.0:1790656537.348884:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:3.0:1790656537.348894:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248755328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656537.348985:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248755328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656537.348993:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:3.0:1790656537.349010:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:3.0:1790656537.349017:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248755200:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656537.349043:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248755200:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656537.349049:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00080000:2.0:1790656537.349386:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656537.351095:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755072 00000100:00100000:0.0:1790656537.351108:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755072 00000100:00100000:0.0:1790656537.351166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:0.0:1790656537.351175:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2341:x1877639248755072:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656537.351248:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2341:x1877639248755072:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 73us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656537.351254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 225 10000000:01000000:0.0:1790656537.375658:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790656537.375665:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94390a3a0800 from 7 10000000:01000000:0.0:1790656537.375670:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790656537.375714:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656537.375737:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656537.375749:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656537.375776:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b97b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790656537.375838:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656537.375881:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554240 going to sleep for 11 seconds 00000100:00100000:3.0:1790656537.377199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760640 00000100:00100000:3.0:1790656537.377216:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760640 00000100:00100000:3.0:1790656537.377272:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790656537.377281:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269760640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656537.377295:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656537.377313:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eabc9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.377337:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.377349:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.377358:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656537.377417:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269760640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656537.377424:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790656537.378349:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b97b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656537.378370:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.378381:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656537.378450:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.378562:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.378613:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1790656537.378710:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760768 00000100:00100000:2.0:1790656537.378716:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760768 00000100:00100000:2.0:1790656537.378759:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790656537.378768:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269760768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.379135:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269760768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656537.379153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790656537.379772:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.379820:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.379863:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.379895:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1790656537.379983:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269760896 00000100:00100000:1.0:1790656537.379989:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269760896 00000100:00100000:1.0:1790656537.380130:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790656537.380140:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269760896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.380354:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269760896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.380361:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790656537.383057:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269760896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790656537.386776:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790656537.387012:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790656537.387044:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790656537.387055:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.387067:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656537.387077:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790656537.387080:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94392d856000 from 7 10000000:01000000:2.0:1790656537.387083:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790656537.387117:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.387125:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.387135:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656537.387161:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.387236:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656537.387278:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656537.387427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761024 00000100:00100000:1.0:1790656537.387434:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761024 00000100:00100000:1.0:1790656537.387486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790656537.387496:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269761024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656537.387508:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656537.387521:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eabd7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.387543:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.387554:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.387562:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148d800, rc 0) 00000100:00100000:1.0:1790656537.387628:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.387635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790656537.387679:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656537.387692:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.387700:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656537.387758:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.387784:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656537.387817:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c94180 going to sleep for 11 seconds 00000100:00100000:1.0:1790656537.387829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761152 00000100:00100000:1.0:1790656537.387833:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761152 00000100:00100000:1.0:1790656537.387854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790656537.387860:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.389396:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1528us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.389407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790656537.389657:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.389707:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.389765:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656537.389788:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656537.390153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761280 00000100:00100000:1.0:1790656537.390160:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761280 00000100:00100000:1.0:1790656537.390233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790656537.390242:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.390416:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.390424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790656537.391586:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790656537.392431:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790656537.393625:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790656537.393664:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656537.393674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.393688:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656537.393698:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656537.393701:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943928721000 from 7 10000000:01000000:3.0:1790656537.393703:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656537.393746:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.393754:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.393764:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656537.393787:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.393842:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.400418:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656537.401134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761408 00000100:00100000:2.0:1790656537.401147:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761408 00000100:00100000:2.0:1790656537.401205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790656537.401216:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269761408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656537.401233:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656537.401254:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066eabe5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.401284:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.401296:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.401304:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481c00, rc 0) 00000100:00100000:2.0:1790656537.401385:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269761408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (7543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656537.401392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790656537.402068:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656537.402088:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656537.402099:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656537.402165:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.402202:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.402240:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656537.402347:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761536 00000100:00100000:2.0:1790656537.402352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761536 00000100:00100000:2.0:1790656537.402375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790656537.402382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269761536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.402667:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269761536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656537.402675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790656537.403143:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.403179:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656537.403222:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656537.403247:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656537.403294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761664 00000100:00100000:2.0:1790656537.403299:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761664 00000100:00100000:2.0:1790656537.403321:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790656537.403327:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269761664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.403559:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269761664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656537.403566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790656537.404155:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269761664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790656537.406486:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790656537.406699:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790656537.406718:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790656537.406744:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656537.406757:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656537.725991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656537.726126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755456 00000100:00100000:1.0:1790656537.726137:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755456 00000100:00100000:1.0:1790656537.726221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:1.0:1790656537.726236:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:5583:x1877639248755456:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656537.726264:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656537.726293:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.726366:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.726401:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.726462:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c800, rc 0) 00000100:00100000:1.0:1790656537.726654:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755456:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 418us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.726666:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:1.0:1790656537.729550:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656537.729587:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755584 00000100:00100000:1.0:1790656537.729620:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755584 00000100:00100000:1.0:1790656537.729667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1790656537.729677:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755584:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.731033:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755584:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 1345us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.731045:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1790656537.733480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656537.733996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755712 00000100:00100000:2.0:1790656537.734007:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755712 00000100:00100000:2.0:1790656537.734095:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:2.0:1790656537.734105:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755712:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656537.734311:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755712:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 206us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656537.734319:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:0.0:1790656537.745348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656537.745650:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755840 00000100:00100000:1.0:1790656537.745661:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755840 00000100:00100000:1.0:1790656537.745712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:1.0:1790656537.745733:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248755840:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656537.745749:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656537.745768:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.745807:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.745819:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656537.745835:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148c200, rc 0) 00000100:00100000:1.0:1790656537.745886:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248755840:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 165us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.745893:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:2.0:1790656537.752052:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656537.752203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248755968 00000100:00100000:1.0:1790656537.752213:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248755968 00000100:00100000:1.0:1790656537.752256:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:1.0:1790656537.752262:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248755968:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656537.752584:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248755968:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 320us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656537.752614:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:2.0:1790656537.762295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656537.762364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756096 00000100:00100000:0.0:1790656537.762383:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756096 00000100:00100000:0.0:1790656537.762437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:0.0:1790656537.762447:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248756096:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656537.762677:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248756096:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 231us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656537.762690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 240 00010000:00010000:3.0:1790656538.336885:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656539.362293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656540.382947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656540.490373:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790656540.831796:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656540.831822:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269761792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656540.831915:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656540.832348:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761792 00000100:00100000:1.0:1790656540.832358:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761792 00000100:00100000:1.0:1790656540.832434:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790656540.832452:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269761792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656540.832490:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656540.832546:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269761792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656540.832553:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790656540.832620:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b0380 x1877639269761792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656540.832637:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269761792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790656540.832753:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790656540.833941:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269762176:0@lo:400:kworker.0 00000100:00100000:3.0:1790656540.833992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656540.834051:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656540.834365:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269762304:0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.834404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656540.834441:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790656540.834463:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269761920:0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.834491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656540.834517:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269762432:0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.834538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656540.834571:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762304 00000100:00100000:2.0:1790656540.834578:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762304 00000100:00100000:2.0:1790656540.834661:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790656540.834670:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269762304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.834730:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269762304:12345-0@lo:400:kworker.0 Request processed in 61us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656540.834736:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790656540.834759:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269761920 00000100:00100000:2.0:1790656540.834762:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269761920 00000100:00100000:2.0:1790656540.834788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790656540.834794:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.834822:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269761920:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656540.834828:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790656540.834855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762176 00000100:00100000:2.0:1790656540.834859:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762176 00000100:00100000:2.0:1790656540.834900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762432 00000100:00100000:2.0:1790656540.834903:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762432 00000100:00100000:2.0:1790656540.834926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790656540.834932:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.838695:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269762176:12345-0@lo:400:kworker.0 Request processed in 3753us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656540.838719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790656540.838778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790656540.838792:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269762432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656540.838865:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269762432:12345-0@lo:400:kworker.0 Request processed in 79us (4325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656540.838872:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790656540.839264:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790656540.839271:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656540.839436:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269762048:0@lo:400:kworker.0 00000100:00100000:3.0:1790656540.839484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656540.839531:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269762176:0@lo:400:kworker.0 00000100:00100000:3.0:1790656540.839571:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762048 00000100:00100000:3.0:1790656540.839578:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762048 00000100:00100000:0.0:1790656540.843453:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269761920:0@lo:400:kworker.0 00000100:00100000:0.0:1790656540.843478:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269762432:0@lo:400:kworker.0 00010000:00080000:0.0:1790656540.843496:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94390977c700 x1877639269762304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656540.843507:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269762304:0@lo:400:kworker.0 00000100:00100000:3.0:1790656540.843841:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790656540.843858:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269762048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656540.843961:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269762048:12345-0@lo:400:kworker.0 Request processed in 111us (4476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656540.843968:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790656540.844052:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269762048:0@lo:400:kworker.0 00010000:00010000:2.0:1790656541.407914:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656542.373745:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269762560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656542.373820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656542.374074:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762560 00000100:00100000:1.0:1790656542.374082:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762560 00000100:00100000:1.0:1790656542.374156:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656542.374166:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269762560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656542.374200:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656542.374248:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269762560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656542.374254:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1790656542.374293:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439281b0380 x1877639269762560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656542.374311:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269762560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790656542.374358:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790656542.431754:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656542.460030:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656542.460075:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656542.460097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656542.460174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756224 00000100:00100000:2.0:1790656542.460183:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756224 00000100:00100000:2.0:1790656542.460243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00100000:2.0:1790656542.460253:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248756224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656542.460321:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248756224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656542.460329:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00100000:2.0:1790656542.460362:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756480 00000100:00100000:2.0:1790656542.460366:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756480 00000100:00100000:2.0:1790656542.460392:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756352 00000100:00100000:2.0:1790656542.460394:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756352 00000100:00100000:2.0:1790656542.460412:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1790656542.460417:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248756480:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656542.460444:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248756480:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656542.460450:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1790656542.460460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:2.0:1790656542.460476:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248756352:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656542.460496:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248756352:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656542.460502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00080000:2.0:1790656542.460624:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656543.455133:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656544.483671:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656545.379196:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:35:42 (1790656542) === 00010000:00010000:0.0:1790656545.506846:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656545.950952:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269762944:0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.951018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656545.951084:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269762816:0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.951105:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762944 00000100:00100000:2.0:1790656545.951115:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762944 00000100:00100000:0.0:1790656545.951120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656545.951150:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269763328:0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.951177:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656545.951182:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762816 00000100:00100000:2.0:1790656545.951186:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762816 00000100:00100000:2.0:1790656545.951215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790656545.951226:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269762944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.951226:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763328 00000100:00100000:0.0:1790656545.951232:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763328 00000100:00100000:0.0:1790656545.951269:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790656545.951278:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269763328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.951287:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269762944:12345-0@lo:400:kworker.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656545.951296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790656545.951319:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790656545.951329:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269762816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.951346:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269763328:12345-0@lo:400:kworker.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656545.951365:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269762816:12345-0@lo:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656545.951370:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1790656545.951389:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656545.951394:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656545.951425:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269762944:0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.951524:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790656545.951555:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269762816:0@lo:400:kworker.0 00010000:00080000:0.0:1790656545.951568:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439280c3b80 x1877639269763328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656545.951577:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269763328:0@lo:400:kworker.0 00000100:00100000:3.0:1790656545.952179:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269762688:0@lo:400:kworker.0 00000100:00100000:3.0:1790656545.952218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656545.952255:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269763200:0@lo:400:kworker.0 00000100:00100000:3.0:1790656545.952277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656545.952298:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656545.952304:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269763072:0@lo:400:kworker.0 00000100:00100000:3.0:1790656545.952322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656545.952392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269762688 00000100:00100000:0.0:1790656545.952398:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269762688 00000100:00100000:0.0:1790656545.952435:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790656545.952442:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269762688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.952483:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269762688:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656545.952489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790656545.952572:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269762688:0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.952691:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763072 00000100:00100000:2.0:1790656545.952702:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763072 00000100:00100000:2.0:1790656545.952915:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790656545.952922:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269763072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.952959:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269763072:12345-0@lo:400:kworker.0 Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656545.952965:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790656545.952981:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763200 00000100:00100000:2.0:1790656545.952984:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763200 00010000:00080000:1.0:1790656545.954735:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439280c1500 x1877639269763072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656545.954750:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269763072:0@lo:400:kworker.0 00000100:00100000:0.0:1790656545.957326:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656545.957346:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269763456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656545.957409:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656545.957465:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763456 00000100:00100000:0.0:1790656545.957473:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763456 00000100:00100000:0.0:1790656545.957520:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790656545.957528:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269763456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656545.957564:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656545.957645:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269763456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656545.957670:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790656545.957716:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b97bb80 x1877639269763456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656545.958093:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269763456:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790656545.960240:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656545.960250:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656545.960415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790656545.960428:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269763200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656545.962021:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269763200:12345-0@lo:400:kworker.0 Request processed in 1594us (9740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656545.962030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790656545.962646:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269763200:0@lo:400:kworker.0 00000100:00100000:1.0:1790656546.051930:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656546.052075:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656546.052368:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756736 00000100:00100000:3.0:1790656546.052377:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756736 00000100:00100000:3.0:1790656546.052438:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1790656546.052449:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:177b5748-b800-471f-9375-621ebde8193b+6:9665:x1877639248756736:12345-192.168.203.23@tcp:700:mkdir.0 00000100:00100000:3.0:1790656546.052530:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:177b5748-b800-471f-9375-621ebde8193b+6:9665:x1877639248756736:12345-192.168.203.23@tcp:700:mkdir.0 Request processed in 83us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656546.052537:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00080000:0.0:1790656546.053500:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656546.060891:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756608 00000100:00100000:2.0:1790656546.060907:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756608 00000100:00100000:2.0:1790656546.060989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1790656546.061000:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248756608:12345-192.168.203.23@tcp:41:mkdir.0 00000004:00000024:2.0:1790656546.061047:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790656546.071884:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248756608:12345-192.168.203.23@tcp:41:mkdir.0 Request processed in 10874us (19951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.071899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1790656546.073903:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.076216:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248756992 00000100:00100000:2.0:1790656546.076230:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248756992 00000100:00100000:2.0:1790656546.076302:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1790656546.076312:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+6:9665:x1877639248756992:12345-192.168.203.23@tcp:36:mkdir.0 00010000:00010000:2.0:1790656546.076365:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656546.076462:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaae2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23762e expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.076482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4ac00) 00010000:00010000:2.0:1790656546.076507:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656546.080174:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.080198:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.080212:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.080268:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.080276:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.080283:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656546.090577:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790656546.090633:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090644:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090651:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090656:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656546.090681:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090689:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090704:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656546.090707:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656546.090711:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.090716:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656546.090748:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007021615d reply state 000000003e797b0b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.090757:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656546.090860:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+7:9665:x1877639248756992:12345-192.168.203.23@tcp:36:mkdir.0 Request processed in 14545us (16960us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790656546.090869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:3.0:1790656546.101883:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.101900:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.101908:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.101915:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656546.101920:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.101928:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.101947:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94391836d100) 00010000:00010000:3.0:1790656546.101951:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656546.101956:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.102450:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066eac08 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656546.109062:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.109213:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248757120 00000100:00100000:0.0:1790656546.109223:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248757120 00000100:00100000:0.0:1790656546.109286:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1790656546.109297:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:9668:x1877639248757120:12345-192.168.203.23@tcp:101:chmod.0 00010000:00010000:0.0:1790656546.109321:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656546.109343:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376b3 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109409:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109446:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109459:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656546.109494:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656546.109498:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656546.109537:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109564:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376b3 expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109582:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376b3 expref: 7 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.109639:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656546.109642:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656546.109646:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030800, rc 0) 00000100:00100000:0.0:1790656546.109707:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+7:9668:x1877639248757120:12345-192.168.203.23@tcp:101:chmod.0 Request processed in 412us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656546.109714:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1790656546.120509:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.120628:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248757376 00000100:00100000:0.0:1790656546.120641:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248757376 00000100:00100000:0.0:1790656546.121084:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1790656546.121097:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+7:9668:x1877639248757376:12345-192.168.203.23@tcp:36:chmod.0 00010000:00010000:0.0:1790656546.121172:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656546.121226:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376b3 expref: 7 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.121253:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656546.121270:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656546.121308:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.121325:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.121338:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656546.121813:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073e2404c reply state 00000000fafab0f9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.121826:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790656546.121835:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790656546.121960:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:9668:x1877639248757376:12345-192.168.203.23@tcp:36:chmod.0 Request processed in 864us (1465us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790656546.121968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00010000:00010000:3.0:1790656546.124532:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124554:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124563:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124586:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656546.124621:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124632:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124673:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836da00) 00010000:00010000:3.0:1790656546.124677:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790656546.124683:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.124690:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eac1d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656546.144676:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.146428:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248757504 00000100:00100000:0.0:1790656546.146445:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248757504 00000100:00100000:0.0:1790656546.146539:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1790656546.146551:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+7:9669:x1877639248757504:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:0.0:1790656546.146582:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656546.146672:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376ba expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146794:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146811:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146824:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656546.146869:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656546.146873:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656546.146933:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146964:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ba expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146990:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ba expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.146999:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656546.147002:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656546.147006:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030200, rc 0) 00000100:00100000:0.0:1790656546.147086:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+8:9669:x1877639248757504:12345-192.168.203.23@tcp:101:chown.0 Request processed in 536us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656546.147094:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1790656546.151515:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.151637:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248757632 00000100:00100000:2.0:1790656546.151651:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248757632 00000100:00100000:2.0:1790656546.151733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656546.151746:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+8:9669:x1877639248757632:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:2.0:1790656546.151774:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656546.151800:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eac32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376c1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152111:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152131:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152144:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152163:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152171:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152177:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152456:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152466:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152474:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656546.152513:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656546.152518:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656546.152547:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152563:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152571:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152578:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152585:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.152631:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152641:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152656:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656546.152675:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.152682:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152690:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152705:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152711:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152717:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152722:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.152725:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152731:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff943909b4ac00) 00010000:00010000:2.0:1790656546.152741:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.152743:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152749:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152791:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eac32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c1 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152820:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c1 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.152828:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943909b4ae00) 00010000:00010000:2.0:1790656546.152830:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656546.152833:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656546.153217:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:9669:x1877639248757632:12345-192.168.203.23@tcp:101:chown.0 Request processed in 1472us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.153229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1790656546.163888:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.164085:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248757888 00000100:00100000:0.0:1790656546.164099:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248757888 00000100:00100000:0.0:1790656546.164191:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1790656546.164204:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+9:9669:x1877639248757888:12345-192.168.203.23@tcp:36:chown.0 00010000:00010000:0.0:1790656546.164283:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656546.164318:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c1 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.164342:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943909b4ae00) 00010000:00010000:0.0:1790656546.164355:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656546.164389:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.164405:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.164417:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656546.197758:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1790656546.197828:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e869808 reply state 000000000d17e08a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656546.197844:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790656546.197862:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1790656546.197989:0:6714:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790656546.198012:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+7:9669:x1877639248757888:12345-192.168.203.23@tcp:36:chown.0 Request processed in 33805us (34140us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790656546.198022:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00010000:00010000:2.0:1790656546.198079:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198090:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198099:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198127:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.198133:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198143:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198165:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94391836db00) 00010000:00010000:2.0:1790656546.198168:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790656546.198175:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.198183:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656546.213133:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.213374:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758016 00000100:00100000:0.0:1790656546.213388:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758016 00000100:00100000:0.0:1790656546.213468:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1790656546.213481:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+6:9670:x1877639248758016:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:0.0:1790656546.213517:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656546.213546:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376c8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790656546.215153:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1467us 00010000:00010000:1.0:1790656546.242248:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242291:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242307:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242326:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242334:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242341:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242772:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242782:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242790:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656546.242817:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790656546.242821:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656546.242866:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242881:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242898:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242905:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242912:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656546.242917:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242926:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242940:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656546.242944:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656546.242951:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242957:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eac5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242971:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242978:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242985:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.242990:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656546.242998:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243005:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243013:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9439148d8c00) 00010000:00010000:1.0:1790656546.243016:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656546.243019:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243026:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf400/0x9c3a6e82066eac63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243070:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066eac55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c8 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243089:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c8 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.243098:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:1.0:1790656546.243101:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790656546.243103:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf200, rc 0) 00000100:00100000:1.0:1790656546.243189:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+7:9670:x1877639248758016:12345-192.168.203.23@tcp:101:touch.500 Request processed in 29709us (30070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656546.243200:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1790656546.259408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.260907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758272 00000100:00100000:2.0:1790656546.260925:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758272 00000100:00100000:2.0:1790656546.261113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1790656546.261128:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+7:9670:x1877639248758272:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:2.0:1790656546.261158:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656546.261183:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eac71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376cf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261537:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261556:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261569:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261617:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.261633:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790656546.263143:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790656546.263475:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eac86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263493:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eac86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263506:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eac86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263550:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263558:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263566:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263572:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.263577:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263644:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263659:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656546.263673:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.263680:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263687:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eac78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656546.263844:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbd8359b reply state 00000000841f86aa transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656546.263855:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790656546.263900:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eac71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376cf expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263918:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eac86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376cf expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.263926:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4af00) 00010000:00010000:2.0:1790656546.263929:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656546.263931:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480c00, rc 0) 00000100:00100000:2.0:1790656546.264130:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+10:9670:x1877639248758272:12345-192.168.203.23@tcp:101:touch.500 Request processed in 3004us (4739us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790656546.264141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00010000:00010000:2.0:1790656546.267026:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267067:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267076:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267083:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.267088:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267097:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267117:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x13d158c1 (ffff943909b4ac00) 00010000:00010000:2.0:1790656546.267121:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.267126:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.267132:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.268261:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.268384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758528 00000100:00100000:2.0:1790656546.268397:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758528 00000100:00100000:2.0:1790656546.268464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1790656546.268474:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:9670:x1877639248758528:12345-192.168.203.23@tcp:36:touch.500 00010000:00010000:2.0:1790656546.268536:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656546.268560:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eac86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376cf expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.268611:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4af00) 00010000:00010000:2.0:1790656546.268623:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656546.268689:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.268911:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.268924:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656546.269083:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e0bb251 reply state 00000000ced9816b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656546.269094:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656546.269209:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+10:9670:x1877639248758528:12345-192.168.203.23@tcp:36:touch.500 Request processed in 736us (957us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790656546.269215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00010000:00010000:3.0:1790656546.271753:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271775:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271784:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271791:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656546.271809:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271819:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271862:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4a300) 00010000:00010000:3.0:1790656546.271866:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656546.271872:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.271878:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eac94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.274106:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.274191:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758656 00000100:00100000:2.0:1790656546.274206:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758656 00000100:00100000:2.0:1790656546.274321:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1790656546.274335:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+9:9670:x1877639248758656:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:2.0:1790656546.274367:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656546.274395:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376d6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.274470:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376d6 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.274510:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376d6 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.274536:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4ac00) 00010000:00010000:2.0:1790656546.274540:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656546.274544:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481200, rc 0) 00000100:00100000:2.0:1790656546.274645:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+10:9670:x1877639248758656:12345-192.168.203.23@tcp:101:touch.500 Request processed in 313us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.274653:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1790656546.276993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.277127:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758784 00000100:00100000:2.0:1790656546.277143:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758784 00000100:00100000:2.0:1790656546.277237:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1790656546.277247:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2338:x1877639248758784:12345-192.168.203.23@tcp:8:touch.500 00010000:00080000:2.0:1790656546.277290:0:8825:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:2.0:1790656546.277331:0:8825:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eaca2 00002000:00100000:2.0:1790656546.277346:0:8825:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 177b5748-b800-471f-9375-621ebde8193b/ffff94393bc29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790656546.277379:0:8825:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790656546.277735:0:8825:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790656546.277777:0:8825:0:(import.c:65:import_set_state_nolock()) ffff94393bc28800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656546.277866:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248758784:12345-192.168.203.23@tcp:8:touch.500 Request processed in 620us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.277875:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656546.280538:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.280644:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248758912 00000100:00100000:2.0:1790656546.280657:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248758912 00000100:00100000:2.0:1790656546.280776:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1790656546.280789:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+6:0:x1877639248758912:12345-192.168.203.23@tcp:2:touch.500 00000100:00080000:0.0:1790656546.281145:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656546.316485:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:0:x1877639248758912:12345-192.168.203.23@tcp:2:touch.500 Request processed in 35682us (35944us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790656546.316524:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000001:00080000:0.0:1790656546.318445:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1790656546.318464:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000100:00100000:1.0:1790656546.319162:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.319370:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248759168 00000100:00100000:2.0:1790656546.319384:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248759168 00000100:00100000:2.0:1790656546.319459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1790656546.319471:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+10:9670:x1877639248759168:12345-192.168.203.23@tcp:35:touch.500 00000100:00100000:2.0:1790656546.319997:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+11:9670:x1877639248759168:12345-192.168.203.23@tcp:35:touch.500 Request processed in 527us (841us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790656546.320007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1790656546.328737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656546.329159:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248759296 00000100:00100000:1.0:1790656546.329173:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248759296 00000100:00100000:3.0:1790656546.329356:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1790656546.329369:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+11:9671:x1877639248759296:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:3.0:1790656546.329402:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656546.329429:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97000/0x9c3a6e82066eaca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376dd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329519:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329536:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329550:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656546.329623:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790656546.329627:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656546.329684:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329714:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97000/0x9c3a6e82066eaca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376dd expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329756:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376dd expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.329766:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:3.0:1790656546.329769:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656546.329774:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97c00, rc 0) 00000100:00100000:3.0:1790656546.329857:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+12:9671:x1877639248759296:12345-192.168.203.23@tcp:101:rm.0 Request processed in 490us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656546.329866:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1790656546.334543:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.334685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248759552 00000100:00100000:0.0:1790656546.334699:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248759552 00000100:00100000:0.0:1790656546.334775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1790656546.334789:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+12:9671:x1877639248759552:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:0.0:1790656546.334818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656546.334844:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376e4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656546.334961:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790656546.335178:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376e4 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.335197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656546.335201:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656546.335207:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376e4 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.335225:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031600, rc 0) 00000100:00100000:0.0:1790656546.335311:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+13:9671:x1877639248759552:12345-192.168.203.23@tcp:101:rm.0 Request processed in 525us (779us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1790656546.335319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1790656546.339949:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.340298:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248759680 00000100:00100000:2.0:1790656546.340314:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248759680 00000100:00100000:2.0:1790656546.340392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1790656546.340406:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+13:9671:x1877639248759680:12345-192.168.203.23@tcp:37:rm.0 00000100:00100000:2.0:1790656546.345827:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+13:9671:x1877639248759680:12345-192.168.203.23@tcp:37:rm.0 Request processed in 5407us (5877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.345845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1790656546.349676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656546.349794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248759936 00000100:00100000:3.0:1790656546.349807:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248759936 00000100:00100000:3.0:1790656546.349888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1790656546.349902:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+13:9671:x1877639248759936:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:3.0:1790656546.350330:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+14:9671:x1877639248759936:12345-192.168.203.23@tcp:35:rm.0 Request processed in 430us (677us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790656546.350340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1790656546.353513:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.353627:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248760192 00000100:00100000:2.0:1790656546.353641:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248760192 00000100:00100000:2.0:1790656546.353731:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1790656546.353743:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+14:9671:x1877639248760192:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:2.0:1790656546.353775:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656546.353801:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eacc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376eb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.354130:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaccc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.354167:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.354183:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656546.354197:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790656546.354406:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eacc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376eb expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.354431:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376eb expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.354441:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656546.354445:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790656546.354449:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656546.354536:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760192:12345-192.168.203.23@tcp:101:rm.0 Request processed in 794us (1035us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790656546.354544:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1790656546.357481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.357585:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248760320 00000100:00100000:2.0:1790656546.357627:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248760320 00000100:00100000:2.0:1790656546.357702:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1790656546.357714:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760320:12345-192.168.203.23@tcp:41:rm.0 00000004:00000024:2.0:1790656546.357792:0:6714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790656546.358164:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760320:12345-192.168.203.23@tcp:41:rm.0 Request processed in 450us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.358173:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1790656546.360158:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656546.360286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248760448 00000100:00100000:2.0:1790656546.360298:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248760448 00000100:00100000:2.0:1790656546.360363:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:2.0:1790656546.360373:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760448:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:2.0:1790656546.360399:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656546.360424:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eacda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376f2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360503:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360520:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360534:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360551:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360558:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360823:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360832:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.360857:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656546.360889:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790656546.361051:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656546.361081:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361096:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361105:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361112:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361119:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361125:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.361129:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361139:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361152:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656546.361156:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.361161:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361179:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eace1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361196:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361202:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361208:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361213:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.361216:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361223:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x13d158c1 (ffff943909b4a000) 00010000:00010000:2.0:1790656546.361233:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.361236:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361242:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066eace8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361279:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eacda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f2 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361295:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f2 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.361308:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4ac00) 00010000:00010000:2.0:1790656546.361310:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656546.361314:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656546.361441:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+17:9671:x1877639248760448:12345-192.168.203.23@tcp:101:rm.0 Request processed in 1068us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656546.361448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:1.0:1790656546.363941:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656546.364071:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248760704 00000100:00100000:0.0:1790656546.364097:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248760704 00000100:00100000:0.0:1790656546.364182:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1790656546.364191:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+17:9671:x1877639248760704:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:0.0:1790656546.364250:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790656546.364281:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eacef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f2 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364308:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eac9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376d6 expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364320:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff943909b4ac00) 00010000:00010000:0.0:1790656546.364340:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066eacb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376dd expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364355:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656546.364359:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656546.364383:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364397:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364405:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364417:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364422:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364435:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364558:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364565:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.364573:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656546.365549:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790656546.365564:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 261501971600ns, next at 262501967767ns, rc = 0 00010000:00010000:0.0:1790656546.365702:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365715:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365724:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365731:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365736:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365740:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365767:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790656546.365789:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656546.365789:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365798:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365802:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365806:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.365808:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365809:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365825:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365827:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656546.365834:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365838:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94391836d800) 00010000:00010000:0.0:1790656546.365844:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790656546.365848:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365850:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365854:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ead04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365873:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94391836d800) 00010000:00010000:2.0:1790656546.365878:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790656546.365878:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365882:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365884:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365896:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365904:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656546.365908:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365911:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030a00/0x9c3a6e82066ead0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365913:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365928:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656546.365931:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656546.365934:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.365938:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031600/0x9c3a6e82066eacf6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365942:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656546.365946:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1790656546.365947:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063b48e19 reply state 00000000883f54fd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.365949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656546.365955:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656546.366182:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760704:12345-192.168.203.23@tcp:36:rm.0 Request processed in 1989us (2253us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790656546.366189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00010000:00010000:2.0:1790656546.368747:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.368781:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.368787:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.368790:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656546.368795:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.368810:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.368815:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1790656546.368828:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x13d158c1 (ffff94391836d500) 00010000:00010000:2.0:1790656546.368832:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656546.368836:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656546.368842:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066eacfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x13d158c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656546.369019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248760960 00000100:00100000:1.0:1790656546.369032:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248760960 00000100:00100000:1.0:1790656546.369103:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1790656546.369116:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+15:9671:x1877639248760960:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:1.0:1790656546.369519:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248760960:12345-192.168.203.23@tcp:35:rm.0 Request processed in 405us (710us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790656546.369528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1790656546.371146:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656546.371277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761216 00000100:00100000:1.0:1790656546.371287:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761216 00000100:00100000:1.0:1790656546.371350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1790656546.371359:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+16:9671:x1877639248761216:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:1.0:1790656546.371424:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790656546.371452:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376eb expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.371474:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf200/0x9c3a6e82066eac6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376c8 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.372335:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9439148d8200) 00010000:00010000:1.0:1790656546.372438:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066eac2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ba expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656546.372453:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656546.372463:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656546.372704:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.372721:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.372755:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.372771:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.372779:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.372786:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.373119:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.373129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.373136:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656546.374341:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790656546.374442:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374452:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374461:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374469:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656546.374481:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374491:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374571:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94391836da00) 00010000:00010000:0.0:1790656546.374575:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790656546.374582:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066ead20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374711:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374717:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374724:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374730:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656546.374733:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374739:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374749:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656546.374753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656546.374764:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.374771:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066ead12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656546.374787:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094597661 reply state 00000000097b2d83 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656546.374797:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656546.374909:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+15:9671:x1877639248761216:12345-192.168.203.23@tcp:36:rm.0 Request processed in 3546us (3859us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790656546.374918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00010000:00010000:3.0:1790656546.377582:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377760:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377769:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377776:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656546.377802:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377811:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377830:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94391836db00) 00010000:00010000:3.0:1790656546.377833:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656546.377838:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656546.377844:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066ead19 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656546.527363:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790656547.486852:0:6979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262623258187ns, next at 263623255922ns, rc = 0 00000100:00100000:0.0:1790656547.486923:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656547.486944:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656547.487012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656547.487130:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763584 00000100:00100000:1.0:1790656547.487138:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763584 00000100:00100000:1.0:1790656547.487202:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790656547.487212:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269763584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656547.487244:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656547.487291:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269763584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656547.487299:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790656547.487340:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bfa2a00 x1877639269763584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656547.487358:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269763584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656547.487524:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790656547.550749:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656547.579887:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656547.579926:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656547.579952:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656547.580222:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761472 00000100:00100000:2.0:1790656547.580232:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761472 00000100:00100000:2.0:1790656547.580294:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:2.0:1790656547.580305:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+14:2342:x1877639248761472:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656547.580383:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+14:2342:x1877639248761472:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 79us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656547.580391:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1790656547.580403:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656547.580463:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761344 00000100:00100000:1.0:1790656547.580468:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761344 00000100:00100000:1.0:1790656547.580503:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00100000:1.0:1790656547.580512:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248761344:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656547.580549:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248761344:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656547.580564:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00100000:2.0:1790656547.581104:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761728 00000100:00100000:2.0:1790656547.581110:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761728 00000100:00100000:3.0:1790656547.581125:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761600 00000100:00100000:3.0:1790656547.581131:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761600 00000100:00100000:2.0:1790656547.581160:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:3.0:1790656547.581172:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1790656547.581174:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248761728:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656547.581185:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248761600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656547.581217:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248761728:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 48us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656547.581225:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248761600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 43us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656547.581227:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:3.0:1790656547.581238:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00080000:0.0:1790656547.581311:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790656548.575795:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656549.608746:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656550.628504:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790656550.765020:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1790656551.070851:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790656551.070872:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269763712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656551.070952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656551.071170:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763712 00000100:00100000:0.0:1790656551.071178:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763712 00000100:00100000:0.0:1790656551.071243:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790656551.071252:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269763712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656551.071284:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656551.071339:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269763712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656551.071357:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1790656551.071397:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6ec380 x1877639269763712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656551.071414:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269763712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790656551.071477:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790656551.071779:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269764096:0@lo:400:kworker.0 00000100:00100000:3.0:1790656551.071812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656551.071848:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790656551.071861:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269764224:0@lo:400:kworker.0 00000100:00100000:3.0:1790656551.071884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.071957:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269763968:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.071985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.072011:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790656551.072017:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269763840:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072049:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.072073:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269764352:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072098:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.072123:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763840 00000100:00100000:2.0:1790656551.072127:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763840 00000100:00100000:2.0:1790656551.072160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790656551.072170:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269763840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072206:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269763840:12345-0@lo:400:kworker.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.072212:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790656551.072240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764096 00000100:00100000:2.0:1790656551.072243:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764096 00000100:00100000:2.0:1790656551.072271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269763968 00000100:00100000:2.0:1790656551.072275:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269763968 00000100:00100000:2.0:1790656551.072285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764352 00000100:00100000:2.0:1790656551.072294:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764352 00000100:00100000:2.0:1790656551.072310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790656551.072315:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072349:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269764096:12345-0@lo:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.072355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790656551.072366:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790656551.072371:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269763968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072394:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269763968:12345-0@lo:400:kworker.0 Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.072399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790656551.072409:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790656551.072414:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269764352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072435:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269764352:12345-0@lo:400:kworker.0 Request processed in 21us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.072440:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1790656551.072461:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656551.072478:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269763840:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072488:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269764352:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072495:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269763968:0@lo:400:kworker.0 00000100:00100000:2.0:1790656551.072521:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269764096:0@lo:400:kworker.0 00000100:00100000:1.0:1790656551.073102:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764224 00000100:00100000:1.0:1790656551.073110:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764224 00000100:00100000:1.0:1790656551.073164:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790656551.073172:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269764224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656551.073219:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269764224:12345-0@lo:400:kworker.0 Request processed in 49us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656551.073225:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790656551.073851:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790656551.073886:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943935112d80 x1877639269764224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656551.073916:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269764224:0@lo:400:kworker.0 00000001:00080000:2.0:1790656551.635325:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1790656551.635348:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1790656551.635371:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1790656551.635630:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269764480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790656551.635696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.635773:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764480 00000100:00100000:2.0:1790656551.635782:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764480 00000100:00100000:2.0:1790656551.635855:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790656551.635865:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269764480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790656551.635896:0:8825:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790656551.635935:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abb4021, atime: 0x6abb4021, ctime: 0x6abb4021, blocks: 0x1 00010000:00010000:2.0:1790656551.635945:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.635961:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=266s v=(0 0) 00010000:00010000:2.0:1790656551.635966:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656551.635972:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.635992:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636003:0:8825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636028:0:8825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636046:0:8825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790656551.636671:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269764480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 805us (972us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790656551.636680:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790656551.636704:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656551.636710:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636720:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656551.636725:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636736:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636755:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636762:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be30880b/0x9c3a6e82066ead27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.636781:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656551.636790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656551.636792:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790656551.636825:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943935111500/2, rc 0, transno 4294967300 00000100:00100000:2.0:1790656551.636832:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269764480:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790656551.649379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790656551.866030:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff36501790 20000000:00000080:1.0:1790656551.866048:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94393fbd5c00 uarg=0000000000000000 20000000:01000000:1.0:1790656551.866087:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790656551.866093:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790656551.866098:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790656551.868106:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790656551.868296:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790656551.877755:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790656551.878700:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790656551.878784:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790656551.878816:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790656551.879808:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.879829:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880288:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880295:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880320:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880328:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880335:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880377:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880393:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 12 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.880407:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764608:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656551.880821:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880841:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 12 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.880851:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935113480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764736:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656551.880887:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880896:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 18 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.880917:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764864:0@lo:104: 00000100:00100000:1.0:1790656551.880958:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656551.880990:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.880999:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 18 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.881006:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764992:0@lo:104: 00000100:00100000:1.0:1790656551.881027:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656551.881049:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.881057:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 18 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.881065:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269765120:0@lo:104: 00000100:00100000:1.0:1790656551.881088:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656551.881098:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656551.882056:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790656551.882076:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764864 00000100:00100000:2.0:1790656551.882083:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764864 00000100:00100000:2.0:1790656551.882122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269764992 00000100:00100000:2.0:1790656551.882126:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269764992 00000100:00100000:2.0:1790656551.882137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765120 00000100:00100000:2.0:1790656551.882140:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765120 00000100:00100000:2.0:1790656551.882152:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790656551.882161:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:11667:x1877639269764864:12345-0@lo:104: 00010000:00010000:2.0:1790656551.882176:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.882251:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790656551.882258:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+5:11667:x1877639269764864:12345-0@lo:104: Request processed in 98us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.882265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790656551.882281:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790656551.882286:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:11667:x1877639269764992:12345-0@lo:104: 00010000:00010000:2.0:1790656551.882294:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.882329:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790656551.882334:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+4:11667:x1877639269764992:12345-0@lo:104: Request processed in 49us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.882340:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790656551.882362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790656551.882367:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:11667:x1877639269765120:12345-0@lo:104: 00010000:00010000:2.0:1790656551.882375:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.882406:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790656551.882410:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4906672e-e41b-4f99-9a3c-531aeecaa79a+3:11667:x1877639269765120:12345-0@lo:104: Request processed in 44us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.882415:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790656551.882529:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935112d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764864:0@lo:104: 00000100:00100000:1.0:1790656551.882537:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764992:0@lo:104: 00000100:00100000:1.0:1790656551.882543:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269765120:0@lo:104: 00010000:00010000:0.0:1790656551.885914:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790656551.885932:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.885943:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656551.885948:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.885958:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656551.885965:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656551.885972:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656551.886031:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886038:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656551.886069:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886076:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c96c00/0x9c3a6e82066eabe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886111:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656551.886115:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886121:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656551.886124:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886131:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656551.886137:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656551.886142:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656551.886155:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886160:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656551.886166:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886173:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928480600/0x9c3a6e82066eabd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabde expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886181:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656551.886184:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886198:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656551.886201:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886207:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656551.886214:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656551.886219:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656551.886231:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886236:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656551.886257:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886264:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031400/0x9c3a6e82066eabc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066eabd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656551.886278:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656551.886280:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656551.886281:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656551.886490:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269765248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656551.886556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656551.886640:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656551.886646:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269765376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656551.886679:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656551.886778:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656551.886788:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269765504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656551.886838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656551.886953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765248 00000100:00100000:1.0:1790656551.886961:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765248 00010000:00010000:1.0:1790656551.886995:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 19 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.887013:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765376 00000100:00100000:1.0:1790656551.887015:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765376 00010000:00010000:1.0:1790656551.887026:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 20 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.887035:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765504 00000100:00100000:1.0:1790656551.887038:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765504 00010000:00010000:1.0:1790656551.887046:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 21 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.887057:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790656551.887064:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3299:x1877639269765248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656551.887075:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656551.887080:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 21 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887088:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 21 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887103:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481c00/0x9c3a6e82066eabec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eabe5 expref: 21 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887114:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656551.887153:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3299:x1877639269765248:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656551.887168:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790656551.887185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790656551.887190:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269765376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656551.887197:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656551.887202:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 19 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887209:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 19 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887219:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148d800/0x9c3a6e82066eabde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eabd7 expref: 19 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887228:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656551.887250:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3299:x1877639269765376:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656551.887256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790656551.887265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790656551.887271:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928789850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3302:x1877639269765504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656551.887279:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656551.887283:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 17 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 17 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887299:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c97800/0x9c3a6e82066eabd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066eabc9 expref: 17 pid: 5836 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.887317:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656551.887343:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928789850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:3302:x1877639269765504:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656551.887349:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790656551.887507:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269765504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656551.887533:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269765376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656551.887541:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269765248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656551.887734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656551.894462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656551.894539:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656551.894641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761856 00000100:00100000:2.0:1790656551.894650:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761856 00010000:00010000:2.0:1790656551.894689:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 13 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656551.894717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248761984 00000100:00100000:2.0:1790656551.894720:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248761984 00010000:00010000:2.0:1790656551.894732:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 14 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656551.894746:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1790656551.894753:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+14:2341:x1877639248761856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656551.894781:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656551.894787:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 14 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894797:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 14 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894816:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656551.894878:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+14:2341:x1877639248761856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.894885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1790656551.894917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1790656551.894934:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248761984:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656551.894942:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656551.894947:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 13 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894955:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 13 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894967:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894975:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.894990:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895007:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895014:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895021:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895027:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656551.895032:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895039:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895048:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656551.895058:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656551.895079:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248761984:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 155us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656551.895085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00010000:00010000:1.0:1790656551.897060:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c200/0x9c3a6e82066eabfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376ac expref: 12 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.897084:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764608:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656551.897096:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148c800/0x9c3a6e82066eabf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376a5 expref: 11 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656551.897104:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935113480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1877639269764736:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656551.897137:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.897148:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.897154:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656551.897161:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead2e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656552.607353:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269765632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656552.607430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656552.607517:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765632 00000100:00100000:0.0:1790656552.607526:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765632 00000100:00100000:0.0:1790656552.607580:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790656552.607629:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269765632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790656552.607673:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656552.607752:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269765632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656552.607759:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790656552.607926:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269765632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790656552.671834:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656552.701129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656552.701168:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656552.701218:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656552.701245:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656552.702382:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762240 00000100:00100000:2.0:1790656552.702404:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762240 00000100:00100000:2.0:1790656552.702491:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762496 00000100:00100000:2.0:1790656552.702495:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762496 00000100:00100000:2.0:1790656552.702520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:2.0:1790656552.702530:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248762240:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1790656552.702624:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656552.702637:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248762240:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 108us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656552.702644:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:0.0:1790656552.702857:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:0.0:1790656552.702868:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248762496:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656552.702917:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248762496:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 52us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656552.702924:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:1.0:1790656552.703263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762112 00000100:00100000:1.0:1790656552.703270:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762112 00000100:00100000:1.0:1790656552.703338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 246 00000100:00100000:1.0:1790656552.703346:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2342:x1877639248762112:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656552.703398:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2342:x1877639248762112:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 52us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656552.703405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 246 00000100:00100000:3.0:1790656552.703422:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762368 00000100:00100000:3.0:1790656552.703427:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762368 00000100:00100000:3.0:1790656552.703463:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1790656552.703470:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248762368:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656552.703500:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248762368:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656552.703506:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00080000:3.0:1790656552.703523:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656553.530719:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656553.530926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762624 00000100:00100000:2.0:1790656553.530936:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762624 00000100:00100000:2.0:1790656553.530991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:2.0:1790656553.531003:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:5583:x1877639248762624:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656553.531019:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656553.531037:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480c00/0x9c3a6e82066ead35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a2376f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656553.531069:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480c00/0x9c3a6e82066ead35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f9 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656553.531081:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480c00/0x9c3a6e82066ead35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f9 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656553.531090:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480c00, rc 0) 00000100:00100000:2.0:1790656553.531154:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248762624:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 153us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.531161:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:0.0:1790656553.542793:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656553.543749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762752 00000100:00100000:1.0:1790656553.543761:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762752 00000100:00100000:1.0:1790656553.543820:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:1.0:1790656553.543831:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248762752:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656553.544100:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248762752:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 270us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656553.544107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:0.0:1790656553.557712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656553.558273:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248762880 00000100:00100000:3.0:1790656553.558284:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248762880 00000100:00100000:3.0:1790656553.558338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:3.0:1790656553.558348:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248762880:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.558578:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248762880:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 230us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.558631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:3.0:1790656553.564001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656553.564103:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763008 00000100:00100000:2.0:1790656553.564111:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763008 00000100:00100000:2.0:1790656553.564167:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 250 00000100:00100000:2.0:1790656553.564190:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:9941:x1877639248763008:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656553.564452:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:9941:x1877639248763008:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 263us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.564462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 250 10000000:01000000:3.0:1790656553.567881:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656553.567888:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94390a3a0800 from 7 10000000:01000000:3.0:1790656553.567893:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656553.567942:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.567955:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.567965:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656553.567991:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269765760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.568055:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656553.568187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765760 00000100:00100000:1.0:1790656553.568194:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765760 00000100:00100000:1.0:1790656553.568245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1790656553.568254:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+16:5840:x1877639269765760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656553.568267:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656553.568281:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ead3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.568305:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ead3c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.568316:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ead3c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.568325:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf200, rc 0) 00000100:00100000:1.0:1790656553.568359:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269765760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656553.568382:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790656553.568826:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.568849:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269765760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656553.568864:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.568873:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656553.568925:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269765888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.568952:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656553.569014:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269765888 00000100:00100000:2.0:1790656553.569020:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269765888 00000100:00100000:2.0:1790656553.569054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790656553.569062:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269765888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656553.569294:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269765888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.569301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1790656553.590023:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.590072:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269765888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.590156:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.590230:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.590270:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656553.590483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766016 00000100:00100000:2.0:1790656553.590491:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766016 00000100:00100000:2.0:1790656553.590541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790656553.590550:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269766016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656553.590807:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269766016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.590815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790656553.590959:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.593341:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11680:1877639269766144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656553.593420:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.593466:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656553.593526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766144 00000100:00100000:0.0:1790656553.593533:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766144 00000100:00100000:0.0:1790656553.593580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790656553.593626:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:11680:x1877639269766144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656553.594072:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:11680:x1877639269766144:12345-0@lo:502:llog_process_th.0 Request processed in 483us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.594080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790656553.598427:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656553.598518:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763136 00000100:00100000:2.0:1790656553.598528:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763136 00000100:00100000:2.0:1790656553.598585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00100000:2.0:1790656553.598623:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:9941:x1877639248763136:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656553.598884:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:9941:x1877639248763136:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 273us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.598893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00100000:0.0:1790656553.603514:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656553.604736:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763264 00000100:00100000:1.0:1790656553.604748:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763264 00000100:00100000:1.0:1790656553.604817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:1.0:1790656553.604829:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:5583:x1877639248763264:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656553.604845:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656553.604865:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9439421cf400/0x9c3a6e82066ead4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237700 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.604893:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9439421cf400/0x9c3a6e82066ead4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237700 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.604905:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9439421cf400/0x9c3a6e82066ead4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237700 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656553.604914:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf400, rc 0) 00000100:00100000:1.0:1790656553.604975:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248763264:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 148us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656553.604982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:3.0:1790656553.610144:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11680:1877639269766144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656553.610195:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656553.610208:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656553.610210:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790656553.610216:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94390a3a0800 00000020:00000080:3.0:1790656553.610219:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790656553.610319:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11680:1877639269766272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656553.610389:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.614079:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656553.618274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766272 00000100:00100000:2.0:1790656553.618290:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766272 00000100:00100000:2.0:1790656553.618411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790656553.618422:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:11680:x1877639269766272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656553.618739:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:11680:x1877639269766272:12345-0@lo:502:llog_process_th.0 Request processed in 319us (8349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.618746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790656553.618848:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11680:1877639269766272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656553.618883:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656553.618891:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656553.618893:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790656553.618897:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790656553.619030:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790656553.619047:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656553.619057:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.619081:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656553.619091:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656553.619093:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94392d856000 from 7 10000000:01000000:3.0:1790656553.619095:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656553.619125:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.619132:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.619142:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656553.619161:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.619196:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656553.619451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656553.625103:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656553.638107:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766400 00000100:00100000:0.0:1790656553.638122:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766400 00000100:00100000:0.0:1790656553.638246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763392 00000100:00100000:0.0:1790656553.638250:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763392 00000100:00100000:0.0:1790656553.638273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790656553.638282:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:5840:x1877639269766400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656553.638298:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656553.638347:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b507a00/0x9c3a6e82066ead58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ead51 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656553.638375:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b507a00/0x9c3a6e82066ead58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ead51 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656553.638385:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b507a00/0x9c3a6e82066ead58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ead51 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656553.638406:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507a00, rc 0) 00000100:00100000:0.0:1790656553.638487:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269766400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (19290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.638494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790656553.638524:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 259 00000100:00100000:0.0:1790656553.638530:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248763392:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656553.640633:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248763392:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 2094us (21176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.640644:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 259 00000100:00100000:0.0:1790656553.643123:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656553.643150:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656553.643164:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656553.643240:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656553.643293:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656553.643331:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff943925514480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656553.643362:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766528 00000100:00100000:0.0:1790656553.643368:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766528 00000100:00100000:0.0:1790656553.643416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790656553.643427:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269766528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656553.643708:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269766528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.643716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790656553.643977:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656553.644013:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656553.644055:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656553.644066:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790656553.647106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766656 00000100:00100000:0.0:1790656553.647120:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766656 00000100:00100000:0.0:1790656553.647158:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790656553.647167:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269766656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656553.647993:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269766656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656553.648150:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269766656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 983us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.648158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790656553.648766:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11683:1877639269766784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656553.648830:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656553.648857:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1790656553.649576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766784 00000100:00100000:0.0:1790656553.649583:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766784 00000100:00100000:0.0:1790656553.649656:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790656553.649664:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:11683:x1877639269766784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656553.651931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:11683:x1877639269766784:12345-0@lo:502:llog_process_th.0 Request processed in 2260us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656553.651944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790656553.669226:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11683:1877639269766784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656553.669405:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656553.669417:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656553.669419:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790656553.669426:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94392d856000 00000020:00000080:1.0:1790656553.669429:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790656553.669973:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11683:1877639269766912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656553.670043:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656553.670080:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656553.670110:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269766912 00000100:00100000:1.0:1790656553.670116:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269766912 00000100:00100000:1.0:1790656553.670160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790656553.670168:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:11683:x1877639269766912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656553.670381:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:11683:x1877639269766912:12345-0@lo:502:llog_process_th.0 Request processed in 212us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656553.670389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790656553.670435:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11683:1877639269766912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790656553.670457:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656553.670462:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656553.670463:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790656553.670467:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790656553.671022:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790656553.671044:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656553.671055:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671067:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656553.671077:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656553.671080:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943928721000 from 7 10000000:01000000:3.0:1790656553.671082:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656553.671117:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671126:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671136:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656553.671153:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.671188:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.671221:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.671265:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656553.671284:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767040 00000100:00100000:3.0:1790656553.671287:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767040 00000100:00100000:3.0:1790656553.671310:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763520 00000100:00100000:3.0:1790656553.671313:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763520 00000100:00100000:3.0:1790656553.671324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790656553.671330:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:5840:x1877639269767040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656553.671340:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656553.671351:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c96e00/0x9c3a6e82066ead66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ead5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671371:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c96e00/0x9c3a6e82066ead66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ead5f expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671379:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c96e00/0x9c3a6e82066ead66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ead5f expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671387:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96e00, rc 0) 00000100:00100000:3.0:1790656553.671424:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269767040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.671430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790656553.671454:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656553.671467:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656553.671475:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656553.671520:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.671543:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.671551:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.671567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767168 00000100:00100000:3.0:1790656553.671571:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767168 00000100:00100000:3.0:1790656553.671587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 265 00000100:00100000:3.0:1790656553.671652:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248763520:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.671918:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:5583:x1877639248763520:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 265us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.671926:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 265 00000100:00100000:3.0:1790656553.672199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790656553.672206:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269767168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.672402:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269767168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.672409:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790656553.672432:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.672467:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.672499:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656553.672515:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.672531:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767296 00000100:00100000:3.0:1790656553.672535:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767296 00000100:00100000:3.0:1790656553.672554:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790656553.672559:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269767296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656553.672696:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:5840:x1877639269767296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.672703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790656553.673438:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4906672e-e41b-4f99-9a3c-531aeecaa79a:5840:1877639269767296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656553.677357:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11684:1877639269767424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656553.679043:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656553.679091:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620300 going to sleep for 11 seconds 00000100:00100000:3.0:1790656553.679140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767424 00000100:00100000:3.0:1790656553.679147:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767424 00000100:00100000:3.0:1790656553.679203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790656553.679212:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:11684:x1877639269767424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656553.679461:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:11684:x1877639269767424:12345-0@lo:502:llog_process_th.0 Request processed in 250us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.679470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790656553.680041:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11684:1877639269767424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790656553.680077:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656553.680086:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656553.680088:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790656553.680096:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff943928721000 00000020:00000080:2.0:1790656553.680098:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790656553.680201:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11684:1877639269767552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656553.680250:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656553.680281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767552 00000100:00100000:2.0:1790656553.680286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767552 00000100:00100000:2.0:1790656553.680321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790656553.680328:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:11684:x1877639269767552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790656553.680901:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2cc0 going to sleep for 11 seconds 00000040:00080000:3.0:1790656553.683313:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790656553.684385:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:11684:x1877639269767552:12345-0@lo:502:llog_process_th.0 Request processed in 4052us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656553.684397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790656553.684847:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4906672e-e41b-4f99-9a3c-531aeecaa79a:11684:1877639269767552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790656553.684882:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656553.684890:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656553.684892:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790656553.684897:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790656553.688574:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790656553.688642:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790656553.688654:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656553.688668:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656553.700964:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656553.704956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763648 00000100:00100000:3.0:1790656553.704970:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763648 00000100:00100000:3.0:1790656553.705033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 270 00000100:00100000:3.0:1790656553.705043:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:9944:x1877639248763648:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790656553.705283:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:9944:x1877639248763648:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 240us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656553.705300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 270 00010000:00010000:3.0:1790656553.709201:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656553.722835:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656553.722959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763776 00000100:00100000:1.0:1790656553.722970:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763776 00000100:00100000:1.0:1790656553.723027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 271 00000100:00100000:1.0:1790656553.723045:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:9944:x1877639248763776:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790656553.723264:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:9944:x1877639248763776:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 221us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656553.723273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 271 00000040:00080000:3.0:1790656554.719991:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790656554.723040:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656555.744209:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656556.190934:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269767680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656556.191061:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656556.191276:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767680 00000100:00100000:1.0:1790656556.191285:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767680 00000100:00100000:1.0:1790656556.191357:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790656556.191367:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269767680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656556.191412:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656556.191457:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269767680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656556.191464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1790656556.191505:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6eed80 x1877639269767680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656556.191524:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269767680:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790656556.191655:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656556.192072:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269767936:0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.192138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656556.192169:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656556.192175:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269768064:0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.192197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656556.192231:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767936 00000100:00100000:2.0:1790656556.192236:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767936 00000100:00100000:2.0:1790656556.192277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768064 00000100:00100000:2.0:1790656556.192280:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768064 00000100:00100000:2.0:1790656556.192308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790656556.192315:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269767936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.192356:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269767936:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656556.192362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790656556.192376:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790656556.192382:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269768064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.192421:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269768064:12345-0@lo:400:kworker.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656556.192434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1790656556.192450:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656556.192469:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269768064:0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.192478:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269767936:0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193135:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269767808:0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656556.193219:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269768320:0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656556.193262:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656556.193268:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269768192:0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656556.193323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768320 00000100:00100000:3.0:1790656556.193328:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768320 00000100:00100000:3.0:1790656556.193363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790656556.193370:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193430:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269768320:12345-0@lo:400:kworker.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656556.193437:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790656556.193458:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768192 00000100:00100000:3.0:1790656556.193461:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768192 00000100:00100000:3.0:1790656556.193487:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656556.193493:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269768192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193522:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269768192:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656556.193528:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1790656556.193546:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656556.193558:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656556.193579:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269768192:0@lo:400:kworker.0 00000100:00100000:3.0:1790656556.193626:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269768320:0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.194205:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269767808 00000100:00100000:2.0:1790656556.194211:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269767808 00000100:00100000:2.0:1790656556.194254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790656556.194272:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269767808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656556.194327:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269767808:12345-0@lo:400:kworker.0 Request processed in 65us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656556.194334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790656556.194946:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269767808:0@lo:400:kworker.0 00010000:00010000:2.0:1790656556.773885:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790656556.798938:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1790656557.728140:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656557.728160:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656557.728251:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656557.728384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768448 00000100:00100000:1.0:1790656557.728393:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768448 00000100:00100000:1.0:1790656557.728498:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790656557.728508:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269768448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656557.728540:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656557.728616:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269768448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656557.728624:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790656557.728811:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790656557.728817:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943935111500, transno 4294967300 00000100:00100000:3.0:1790656557.728842:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269768448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656557.791164:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656557.822369:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656557.822411:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656557.822467:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656557.822507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656557.822534:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764032 00000100:00100000:3.0:1790656557.822543:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764032 00000100:00100000:3.0:1790656557.822627:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764288 00000100:00100000:3.0:1790656557.822631:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764288 00000100:00100000:3.0:1790656557.822679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:3.0:1790656557.822688:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248764032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656557.822758:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764160 00000100:00100000:3.0:1790656557.822775:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248764032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656557.822784:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:1.0:1790656557.822804:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764160 00000100:00100000:3.0:1790656557.822811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1790656557.822825:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248764288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656557.822860:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248764288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656557.822879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:1.0:1790656557.822901:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1790656557.822923:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248764160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1790656557.822926:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656557.822935:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656557.822998:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248764160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 82us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656557.823008:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1790656557.824003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248763904 00000100:00100000:0.0:1790656557.824013:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248763904 00000100:00100000:0.0:1790656557.824094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 273 00000100:00100000:0.0:1790656557.824104:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248763904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656557.824160:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248763904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 57us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656557.824167:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 273 00010000:00010000:2.0:1790656558.814911:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656559.844490:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656560.862980:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656561.311027:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656561.311214:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269768832:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.311347:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.311436:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656561.311443:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269768960:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.311466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.311512:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269768576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656561.311548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.311611:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656561.311618:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269769088:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.311642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.311685:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769088 00000100:00100000:1.0:1790656561.311692:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769088 00000100:00100000:1.0:1790656561.311745:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790656561.311754:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269769088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.311831:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269769088:12345-0@lo:400:kworker.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.311837:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1790656561.311859:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656561.311886:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269769088:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.311920:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768576 00000100:00100000:1.0:1790656561.311955:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768576 00000100:00100000:1.0:1790656561.311988:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790656561.311994:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269768576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656561.312020:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656561.312055:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269768576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.312060:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790656561.312074:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790656561.312091:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f5a3800 x1877639269768576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656561.312107:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269768576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656561.312151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768832 00000100:00100000:1.0:1790656561.312155:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768832 00000100:00100000:1.0:1790656561.312180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768960 00000100:00100000:1.0:1790656561.312183:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768960 00000100:00100000:1.0:1790656561.312205:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790656561.312211:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269768832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.312244:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269768832:12345-0@lo:400:kworker.0 Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.312249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790656561.312260:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790656561.312266:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269768960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.312287:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269768960:12345-0@lo:400:kworker.0 Request processed in 23us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.312292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1790656561.312302:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656561.312316:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269768960:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.312334:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269768832:0@lo:400:kworker.0 00000100:00100000:2.0:1790656561.318424:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269768704:0@lo:400:kworker.0 00000100:00100000:2.0:1790656561.318503:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.318937:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269768704 00000100:00100000:1.0:1790656561.318946:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269768704 00000100:00100000:1.0:1790656561.319018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790656561.319028:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269768704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.319096:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269768704:12345-0@lo:400:kworker.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.319103:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790656561.319148:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269768704:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.320534:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790656561.320549:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269769216:0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.320625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656561.320670:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769216 00000100:00100000:1.0:1790656561.320676:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769216 00000100:00100000:1.0:1790656561.320723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790656561.320740:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269769216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656561.320978:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269769216:12345-0@lo:400:kworker.0 Request processed in 248us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656561.320985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1790656561.321008:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656561.321033:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269769216:0@lo:400:kworker.0 00010000:00010000:3.0:1790656561.887114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656562.846842:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656562.846866:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269769344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656562.846941:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656562.847443:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769344 00000100:00100000:0.0:1790656562.847452:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769344 00000100:00100000:0.0:1790656562.847506:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790656562.847513:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269769344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790656562.847570:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656562.847679:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269769344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656562.847690:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790656562.847784:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269769344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656562.911800:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656562.947005:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656562.947047:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656562.947098:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656562.947134:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656562.947173:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764672 00000100:00100000:2.0:1790656562.947194:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764672 00000100:00100000:2.0:1790656562.947254:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1790656562.947264:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248764672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656562.947442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764544 00000100:00100000:3.0:1790656562.947447:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764544 00000100:00100000:3.0:1790656562.947475:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764800 00000100:00100000:3.0:1790656562.947478:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764800 00000100:00100000:3.0:1790656562.947498:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1790656562.947506:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248764544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656562.947612:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248764544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 106us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656562.947619:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1790656562.947637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:3.0:1790656562.947643:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248764800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656562.947667:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248764800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656562.947672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00080000:1.0:1790656562.948040:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790656562.948045:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656562.948257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764416 00000100:00100000:0.0:1790656562.948263:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764416 00000100:00100000:0.0:1790656562.948310:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 275 00000100:00100000:0.0:1790656562.948317:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248764416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656562.948372:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f4a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248764416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 54us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656562.948379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 275 00000100:00100000:2.0:1790656562.948802:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248764672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1538us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656562.948810:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00010000:00010000:3.0:1790656563.934951:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656564.958842:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790656564.960681:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790656565.982805:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656566.431563:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269769728:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.431761:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269769600:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.431829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656566.431870:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769600 00000100:00100000:0.0:1790656566.431878:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769600 00000100:00100000:2.0:1790656566.431909:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656566.431917:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269769472:0@lo:400:kworker.0 00000100:00100000:0.0:1790656566.431947:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790656566.431958:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.431963:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656566.432017:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769472 00000100:00100000:2.0:1790656566.432022:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769472 00000100:00100000:0.0:1790656566.432037:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269769600:12345-0@lo:400:kworker.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656566.432045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790656566.432060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790656566.432070:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656566.432090:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269769600:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.432115:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269769472:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656566.432116:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269769472:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.432129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790656566.432194:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656566.432206:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269770112:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.432232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656566.432259:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269769984:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.432280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656566.432582:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769984 00000100:00100000:1.0:1790656566.432587:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769984 00000100:00100000:0.0:1790656566.432589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770112 00000100:00100000:0.0:1790656566.432614:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770112 00000100:00100000:0.0:1790656566.432671:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790656566.432679:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269770112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656566.432691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656566.432716:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269770240:0@lo:400:kworker.0 00000100:00100000:3.0:1790656566.432738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656566.432770:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790656566.432781:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269769856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656566.432816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656566.432825:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269770112:12345-0@lo:400:kworker.0 Request processed in 146us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656566.432832:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790656566.432848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769728 00000100:00100000:0.0:1790656566.432852:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769728 00000100:00100000:3.0:1790656566.432858:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269769856 00000100:00100000:3.0:1790656566.432864:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269769856 00000100:00080000:2.0:1790656566.439794:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656566.439806:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790656566.439827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656566.439971:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269770112:0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.440016:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770240 00000100:00100000:2.0:1790656566.440023:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770240 00000100:00100000:2.0:1790656566.440071:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790656566.440080:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.440161:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269770240:12345-0@lo:400:kworker.0 Request processed in 81us (7421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656566.440168:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790656566.440205:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f5a2a00 x1877639269770240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656566.440216:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269770240:0@lo:400:kworker.0 00000100:00100000:0.0:1790656566.440749:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790656566.440758:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656566.440814:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269769728:12345-0@lo:400:kworker.0 Request processed in 57us (8123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656566.440830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790656566.440863:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269769728:0@lo:400:kworker.0 00000100:00100000:3.0:1790656566.441030:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790656566.441039:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269769856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656566.441067:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656566.441109:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269769856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (8293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656566.441115:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1790656566.441142:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f5a1880 x1877639269769856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656566.441158:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269769856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656566.444818:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790656566.444842:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269769984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656566.445561:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269769984:12345-0@lo:400:kworker.0 Request processed in 114us (12664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656566.445569:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790656566.445822:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269769984:0@lo:400:kworker.0 00010000:00010000:2.0:1790656567.007660:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656567.967175:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656567.967199:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269770368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656567.967412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656567.967611:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770368 00000100:00100000:3.0:1790656567.967620:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770368 00000100:00100000:3.0:1790656567.967676:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790656567.967756:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269770368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656567.967791:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656567.967892:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269770368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656567.967899:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790656567.968973:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269770368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656568.033104:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656568.060678:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656568.060726:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656568.060812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765056 00000100:00100000:3.0:1790656568.060821:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765056 00000100:00100000:3.0:1790656568.060903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1790656568.060912:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248765056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656568.060979:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248765056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656568.060986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:2.0:1790656568.061204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248764928 00000100:00100000:2.0:1790656568.061209:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248764928 00000100:00100000:2.0:1790656568.061245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 277 00000100:00100000:2.0:1790656568.061260:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248764928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656568.061297:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248764928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656568.061303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 277 00000100:00080000:0.0:1790656568.061758:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656568.080479:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656568.080635:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656568.080740:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765312 00000100:00100000:1.0:1790656568.080750:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765312 00000100:00100000:1.0:1790656568.080832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:1.0:1790656568.080843:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248765312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656568.080928:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248765312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656568.080935:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00080000:0.0:1790656568.081093:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656568.088067:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765184 00000100:00100000:2.0:1790656568.088085:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765184 00000100:00100000:2.0:1790656568.088252:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656568.088263:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2338:x1877639248765184:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:2.0:1790656568.088296:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaca2 00000100:00080000:2.0:1790656568.088306:0:6690:0:(import.c:65:import_set_state_nolock()) ffff94393bc28800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790656568.088347:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1790656568.088651:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+2:2338:x1877639248765184:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 389us (8180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656568.088659:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:2.0:1790656568.088681:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790656568.089906:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790656569.054877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656570.081468:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656571.104929:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656571.551053:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269770880:0@lo:400:kworker.0 00000100:00100000:0.0:1790656571.551129:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656571.551202:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656571.551211:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269770752:0@lo:400:kworker.0 00000100:00100000:0.0:1790656571.551239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656571.551285:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770880 00000100:00100000:0.0:1790656571.551294:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770880 00000100:00100000:0.0:1790656571.551357:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790656571.551370:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269770880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551409:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269770624:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656571.551471:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269771136:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656571.551533:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269770496:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770752 00000100:00100000:3.0:1790656571.551575:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770752 00000100:00100000:1.0:1790656571.551580:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656571.551632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770624 00000100:00100000:3.0:1790656571.551635:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770624 00000100:00100000:1.0:1790656571.551643:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269771008:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790656571.551668:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656571.551677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656571.551709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269770496 00000100:00100000:3.0:1790656571.551715:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269770752:12345-0@lo:400:kworker.0 Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656571.551715:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269770496 00000100:00100000:3.0:1790656571.551724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790656571.551742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771008 00000100:00100000:3.0:1790656571.551747:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771008 00000100:00100000:1.0:1790656571.551753:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1790656571.551764:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269770496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790656571.551780:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269770624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656571.551791:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771136 00000100:00100000:2.0:1790656571.551798:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771136 00000100:00100000:1.0:1790656571.551813:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269770496:12345-0@lo:400:kworker.0 Request processed in 50us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656571.551822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790656571.551827:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269770624:12345-0@lo:400:kworker.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656571.551840:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790656571.551840:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790656571.551855:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269771136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551866:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790656571.551879:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269770496:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.551885:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269771008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656571.551905:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269771136:12345-0@lo:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656571.551914:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790656571.551936:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269771008:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00080000:1.0:1790656571.551936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656571.551945:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656571.551949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1790656571.551951:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656571.551989:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269770752:0@lo:400:kworker.0 00000100:00100000:2.0:1790656571.551990:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269771264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656571.552006:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269770624:0@lo:400:kworker.0 00000100:00100000:1.0:1790656571.552014:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269770880:0@lo:400:kworker.0 00010000:00080000:3.0:1790656571.552027:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94391f5a1f80 x1877639269771136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790656587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656571.552035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656571.552046:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269771136:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.552076:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771264 00000100:00100000:3.0:1790656571.552080:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771264 00000100:00100000:1.0:1790656571.552097:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269771008:0@lo:400:kworker.0 00000100:00100000:3.0:1790656571.552461:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656571.552470:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269771264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656571.552503:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656571.552549:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269771264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656571.552556:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1790656571.552613:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6ec380 x1877639269771264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656571.552628:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269771264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656571.552691:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269770880:12345-0@lo:400:kworker.0 Request processed in 1324us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656571.552699:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1790656572.129354:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790656572.153785:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:1.0:1790656572.153793:0:6716:0:(genops.c:885:class_export_put()) final put ffff94393bc29800/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:2.0:1790656572.155757:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bc29800/177b5748-b800-471f-9375-621ebde8193b for lustre-OST0000 00000020:00000080:2.0:1790656572.155828:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94393bc28800 for lustre-OST0000 00000100:00100000:1.0:1790656573.095501:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269771392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656573.095613:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656573.095743:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771392 00000100:00100000:3.0:1790656573.095751:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771392 00000100:00100000:3.0:1790656573.095815:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790656573.095825:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269771392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656573.095857:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656573.095916:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269771392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656573.095922:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790656573.097391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656573.097447:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269771392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790656573.151162:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656573.192689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656573.192724:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656573.192754:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656573.192793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765696 00000100:00100000:1.0:1790656573.192802:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765696 00000100:00100000:1.0:1790656573.192855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765568 00000100:00100000:1.0:1790656573.192858:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765568 00000100:00100000:1.0:1790656573.192881:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:1.0:1790656573.192889:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248765696:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656573.192953:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2341:x1877639248765696:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656573.192959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:1.0:1790656573.192975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1790656573.192981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248765568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656573.193017:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+5:2341:x1877639248765568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 36us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656573.193023:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00080000:1.0:1790656573.193044:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656573.194128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765440 00000100:00100000:3.0:1790656573.194136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765440 00000100:00100000:3.0:1790656573.194177:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 279 00000100:00100000:3.0:1790656573.194185:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248765440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656573.194348:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248765440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 47us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656573.194356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 279 00010000:00010000:3.0:1790656574.175879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790656574.176454:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790656575.198769:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790656575.470189:0:11851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:36:13 (1790656573) 00010000:00010000:3.0:1790656576.223220:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656576.671477:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656576.671549:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656576.671678:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269771520:0@lo:400:kworker.0 00000100:00100000:3.0:1790656576.671714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656576.671781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771520 00000100:00100000:0.0:1790656576.671789:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771520 00000100:00100000:0.0:1790656576.671832:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790656576.671841:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269771520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.672849:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771648 00000100:00100000:2.0:1790656576.672857:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771648 00000100:00100000:2.0:1790656576.673414:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790656576.673423:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269771648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656576.673480:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656576.673536:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269771648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656576.673543:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790656576.673619:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269771904:0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.673652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656576.673689:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656576.673696:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269771776:0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.673716:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790656576.673764:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393b6ee300 x1877639269771648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656576.673782:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656576.673796:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656576.673801:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269772032:0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.673822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656576.673852:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771904 00000100:00100000:2.0:1790656576.673856:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771904 00000100:00100000:2.0:1790656576.673879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269771776 00000100:00100000:2.0:1790656576.673881:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269771776 00000100:00100000:2.0:1790656576.673894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790656576.673899:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.674558:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269771904:12345-0@lo:400:kworker.0 Request processed in 656us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656576.674566:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790656576.674610:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790656576.674617:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.674647:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269771776:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656576.674652:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1790656576.674672:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790656576.674676:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656576.674698:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269771776:0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.674708:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269771904:0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.674749:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269772032 00000100:00100000:2.0:1790656576.674753:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269772032 00000100:00100000:2.0:1790656576.674786:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790656576.674794:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269772032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656576.674844:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269772032:12345-0@lo:400:kworker.0 Request processed in 51us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656576.674850:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1790656576.674866:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656576.674882:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269772032:0@lo:400:kworker.0 00000100:00100000:0.0:1790656576.677156:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269771520:12345-0@lo:400:kworker.0 Request processed in 5307us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656576.677170:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1790656576.680769:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269771520:0@lo:400:kworker.0 00000100:00100000:3.0:1790656576.681132:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943802a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269772160:0@lo:400:kworker.0 00000100:00100000:3.0:1790656576.681192:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656576.681887:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269772160 00000100:00100000:0.0:1790656576.681896:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269772160 00000100:00100000:0.0:1790656576.682004:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790656576.682014:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269772160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656576.682106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269772160:12345-0@lo:400:kworker.0 Request processed in 93us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656576.682113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790656576.682194:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943802a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269772160:0@lo:400:kworker.0 00000100:00080000:1.0:1790656576.685009:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656577.089902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656577.090937:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765824 00000100:00100000:2.0:1790656577.090952:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765824 00000100:00080000:1.0:1790656577.091048:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656577.091058:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1790656577.091072:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+5:10214:x1877639248765824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790656577.091090:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656577.091136:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066ead6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237707 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091345:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091360:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091374:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656577.091407:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656577.091411:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656577.091459:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091483:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066ead6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237707 expref: 7 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091502:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237707 expref: 6 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656577.091512:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a500) 00010000:00010000:2.0:1790656577.091515:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656577.091518:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480600, rc 0) 00000100:00100000:2.0:1790656577.092944:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+6:10214:x1877639248765824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1869us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656577.092954:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:1.0:1790656577.100801:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656577.100979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248765952 00000100:00100000:0.0:1790656577.100990:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248765952 00000100:00100000:0.0:1790656577.101096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1790656577.101107:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+6:10215:x1877639248765952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656577.101128:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656577.101147:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066ead7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23770e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101233:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101244:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101260:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101266:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101272:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101482:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101491:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101499:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656577.101524:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656577.101528:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656577.101547:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101559:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101574:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101580:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101586:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656577.101635:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101644:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101656:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a500) 00010000:00010000:0.0:1790656577.101659:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656577.101664:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101670:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066ead82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101684:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101689:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101711:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101717:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656577.101726:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101733:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101741:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94391836d000) 00010000:00010000:0.0:1790656577.101743:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656577.101746:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101752:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066ead89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101780:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066ead7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23770e expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101794:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23770e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656577.101800:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94391836df00) 00010000:00010000:0.0:1790656577.101802:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656577.101804:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507c00, rc 0) 00000100:00100000:0.0:1790656577.101869:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+7:10215:x1877639248765952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 764us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656577.101876:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1790656577.107358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656577.109082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766208 00000100:00100000:3.0:1790656577.109100:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766208 00000100:00100000:3.0:1790656577.109192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1790656577.109204:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+7:10215:x1877639248766208:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656577.109230:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656577.109256:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ead97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237715 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.109350:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.109391:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.109414:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112150:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112174:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112187:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112526:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066eadac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112535:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066eadac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112542:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066eadac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656577.112553:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790656577.112879:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112888:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112895:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112910:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656577.112914:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112922:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94391836df00) 00010000:00010000:3.0:1790656577.112938:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656577.112943:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112950:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ead9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112962:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112968:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112974:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112980:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656577.112982:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.112989:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.113006:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9439086c3600) 00010000:00010000:3.0:1790656577.113008:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656577.113011:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.113017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eada5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.113831:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ead97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237715 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.113849:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066eadac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237715 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656577.113857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:3.0:1790656577.113860:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656577.113862:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97200, rc 0) 00000100:00100000:3.0:1790656577.113929:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+9:10215:x1877639248766208:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4726us (6583us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790656577.113942:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1790656577.117088:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656577.117163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766336 00000100:00100000:3.0:1790656577.117177:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766336 00000100:00100000:3.0:1790656577.117247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1790656577.117258:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:10215:x1877639248766336:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790656577.117372:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:10215:x1877639248766336:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656577.117380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000001:00080000:2.0:1790656577.239632:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1790656577.248859:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790656577.254687:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790656578.213740:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269772288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656578.213810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656578.213874:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269772288 00000100:00100000:3.0:1790656578.213882:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269772288 00000100:00100000:3.0:1790656578.213932:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790656578.213942:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943802a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269772288:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656578.213969:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790656578.213972:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656578.216350:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943802a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269772288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2404us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656578.216362:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790656578.216532:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269772288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656578.271812:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656578.301861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656578.301910:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656578.301943:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656578.301973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766720 00000100:00100000:3.0:1790656578.301982:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766720 00000100:00100000:3.0:1790656578.302046:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766592 00000100:00100000:3.0:1790656578.302050:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766592 00000100:00100000:3.0:1790656578.302076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:3.0:1790656578.302086:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248766720:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656578.302156:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248766720:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656578.302164:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:3.0:1790656578.302184:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:3.0:1790656578.302191:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248766592:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656578.302219:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248766592:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656578.302227:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1790656578.303264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766464 00000100:00100000:1.0:1790656578.303271:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766464 00000100:00100000:1.0:1790656578.303312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00100000:1.0:1790656578.303320:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248766464:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656578.303356:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248766464:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656578.303362:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00080000:1.0:1790656578.303390:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656578.985721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656578.991002:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248766848 00000100:00100000:2.0:1790656578.991016:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248766848 00000100:00100000:2.0:1790656578.991077:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1790656578.991087:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:10257:x1877639248766848:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656578.991107:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656578.991127:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eadba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23771c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991201:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991215:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991228:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991234:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991452:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991462:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991480:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991487:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656578.991491:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991499:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991511:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a500) 00010000:00010000:2.0:1790656578.991515:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656578.991658:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991667:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eadc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991678:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991685:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991692:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991698:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656578.991702:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991718:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991728:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff943909b4a200) 00010000:00010000:2.0:1790656578.991731:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656578.991733:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991739:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eadc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991771:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eadba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23771c expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991782:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a500) 00010000:00010000:2.0:1790656578.991785:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656578.991789:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eadba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23771c expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656578.991798:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656578.991863:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:10257:x1877639248766848:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 777us (6152us total) trans 0 rc 301/301 00000100:00100000:2.0:1790656578.991870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1790656578.997199:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656578.998890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767104 00000100:00100000:3.0:1790656578.998901:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767104 00000100:00100000:3.0:1790656578.999012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1790656578.999022:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+8:10257:x1877639248767104:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1790656578.999075:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656578.999876:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ead74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237707 expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656578.999897:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a500) 00010000:00010000:3.0:1790656578.999907:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656579.000319:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.000334:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.000345:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.000358:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.000366:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.000372:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.004685:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790656579.004702:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004713:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004726:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004732:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.004736:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004743:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004759:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656579.004762:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.004766:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.004773:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadcf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656579.004790:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a09cea31 reply state 00000000cb46222e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656579.004800:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656579.005244:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:10257:x1877639248767104:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 6218us (8047us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790656579.005252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00010000:00010000:3.0:1790656579.008191:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008205:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008228:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008234:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.008238:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008247:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008268:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9439086c3900) 00010000:00010000:3.0:1790656579.008272:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.008277:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.008283:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadd6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656579.153167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.153311:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767232 00000100:00100000:2.0:1790656579.153321:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767232 00000100:00100000:2.0:1790656579.153399:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1790656579.153410:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+8:10265:x1877639248767232:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:2.0:1790656579.153460:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656579.153483:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237723 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790656579.153542:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656579.153546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.153560:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.153571:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656579.153644:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656579.153649:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656579.153687:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.153710:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237723 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.153728:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237723 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.153983:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:2.0:1790656579.153986:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656579.153990:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481200, rc 0) 00000100:00100000:2.0:1790656579.154053:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+9:10265:x1877639248767232:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 644us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656579.154060:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1790656579.240403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.240506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767360 00000100:00100000:3.0:1790656579.240516:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767360 00000100:00100000:3.0:1790656579.240572:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1790656579.240583:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+9:10271:x1877639248767360:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656579.240627:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.240646:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23772a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240708:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240738:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240750:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240764:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240770:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240776:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240865:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240872:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.240879:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.240901:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790656579.240905:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656579.241079:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241094:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241111:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241117:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241124:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.241128:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241135:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241148:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:3.0:1790656579.241151:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.241156:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241162:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eadf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241176:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241181:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241186:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241191:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.241200:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241206:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241214:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9439086c3900) 00010000:00010000:3.0:1790656579.241216:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.241219:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eadf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241266:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eadeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23772a expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241279:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23772a expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.241286:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656579.241288:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790656579.241291:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96800, rc 0) 00000100:00100000:3.0:1790656579.241405:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+10:10271:x1877639248767360:12345-192.168.203.23@tcp:101:bash.0 Request processed in 822us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656579.241413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1790656579.249887:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.250276:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767616 00000100:00100000:2.0:1790656579.250287:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767616 00000100:00100000:2.0:1790656579.250355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656579.250365:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+10:10271:x1877639248767616:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656579.250384:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656579.250402:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237731 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250533:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250547:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250557:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250569:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250574:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.250580:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790656579.251989:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1790656579.253315:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254198:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254229:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254283:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254290:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254295:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656579.254299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254306:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254317:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656579.254320:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656579.254324:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254330:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656579.254689:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cea76c1a reply state 000000004c03e2e5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656579.254698:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790656579.254761:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254839:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.254847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656579.254850:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656579.254853:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480600, rc 0) 00000100:00100000:2.0:1790656579.254932:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+13:10271:x1877639248767616:12345-192.168.203.23@tcp:101:bash.0 Request processed in 4567us (5165us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790656579.254941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00010000:00010000:3.0:1790656579.257660:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257677:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257698:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257705:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.257710:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257718:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257733:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4ae00) 00010000:00010000:3.0:1790656579.257736:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.257742:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.257748:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eae15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656579.262460:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.263369:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767744 00000100:00100000:2.0:1790656579.263380:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767744 00000100:00100000:2.0:1790656579.263875:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1790656579.263883:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2338:x1877639248767744:12345-192.168.203.23@tcp:8:bash.0 00010000:00080000:2.0:1790656579.263917:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:2.0:1790656579.263947:0:6690:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eae2a 00002000:00100000:2.0:1790656579.263958:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 177b5748-b800-471f-9375-621ebde8193b/ffff94393bc2a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790656579.263981:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790656579.264215:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790656579.264246:0:6690:0:(import.c:65:import_set_state_nolock()) ffff94393bc2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656579.264320:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248767744:12345-192.168.203.23@tcp:8:bash.0 Request processed in 436us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656579.264328:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1790656579.274896:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.277064:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248767872 00000100:00100000:2.0:1790656579.277092:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248767872 00000100:00100000:2.0:1790656579.277186:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1790656579.277197:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:0:x1877639248767872:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656579.277215:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656579.277239:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237738 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790656579.277265:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790656579.277283:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1790656579.277287:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656579.277296:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.277316:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.277329:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656579.277398:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:0:x1877639248767872:12345-192.168.203.23@tcp:101:bash.0 Request processed in 203us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656579.277405:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00080000:1.0:1790656579.277491:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790656579.294754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.296011:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248768000 00000100:00100000:0.0:1790656579.296022:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248768000 00000100:00100000:0.0:1790656579.296089:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1790656579.296099:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:10271:x1877639248768000:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656579.296131:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656579.296152:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23773f expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.296184:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.296193:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656579.296197:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656579.296203:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.296235:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.296249:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 8 pid: 6692 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.296263:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8825:1877639269772416:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656579.296342:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e180 going to sleep for 11 seconds 00010000:00010000:0.0:1790656579.298002:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656579.299841:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8825:1877639269772416:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656579.299883:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656579.300064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.300134:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248768128 00000100:00100000:0.0:1790656579.300141:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248768128 00010000:00010000:0.0:1790656579.300172:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 9 pid: 6692 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.300228:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1790656579.300237:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248768128:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656579.300250:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656579.300272:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 9 pid: 6692 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.300284:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 9 pid: 6692 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.300307:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b422b3a/0x9c3a6e82066eae31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237738 expref: 9 pid: 6692 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.300323:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656579.300327:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656579.300335:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.300346:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.300381:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.300394:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877639269772544:192.168.203.23@tcp:105: 00000100:00100000:0.0:1790656579.300485:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790656579.300661:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506800, rc 0) 00000100:00100000:1.0:1790656579.300692:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+8:10271:x1877639248768000:12345-192.168.203.23@tcp:101:bash.0 Request processed in 4594us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656579.300700:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1790656579.310540:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877639269772544:192.168.203.23@tcp:105: 00010000:00010000:1.0:1790656579.310568:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656579.310982:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248768128:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 10744us (10918us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656579.310993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1790656579.311461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656579.312027:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248768384 00000100:00100000:1.0:1790656579.312035:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248768384 00000100:00100000:1.0:1790656579.312093:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1790656579.312103:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+12:10271:x1877639248768384:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1790656579.312412:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+13:10271:x1877639248768384:12345-192.168.203.23@tcp:35:bash.0 Request processed in 309us (952us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790656579.312444:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1790656579.382310:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.382824:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248768640 00000100:00100000:0.0:1790656579.382834:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248768640 00000100:00100000:3.0:1790656579.382988:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:3.0:1790656579.383001:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+13:10281:x1877639248768640:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656579.383027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.383048:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eae3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237746 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.383168:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790656579.383280:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eae3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.383294:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:3.0:1790656579.383298:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656579.383303:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eae3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.383316:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656579.383989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+14:10281:x1877639248768640:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 383us (1080us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790656579.383999:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1790656579.391238:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656579.391321:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248768896 00000100:00100000:1.0:1790656579.391331:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248768896 00000100:00100000:1.0:1790656579.391387:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1790656579.391398:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+14:10281:x1877639248768896:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656579.392048:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+15:10281:x1877639248768896:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 650us (818us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790656579.392056:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656579.453289:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.453436:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769024 00000100:00100000:3.0:1790656579.453446:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769024 00000100:00100000:3.0:1790656579.453502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1790656579.453511:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+15:10287:x1877639248769024:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656579.453536:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.453554:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eae4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23774d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.453942:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.453956:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.453983:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.454014:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790656579.454017:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656579.454031:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.454054:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eae4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23774d expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.454070:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23774d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.454078:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656579.454081:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656579.454131:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96c00, rc 0) 00000100:00100000:3.0:1790656579.454251:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+16:10287:x1877639248769024:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 738us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656579.454258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1790656579.462839:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.462983:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769280 00000100:00100000:0.0:1790656579.462993:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769280 00000100:00100000:0.0:1790656579.463061:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1790656579.463070:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+16:10287:x1877639248769280:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656579.463714:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656579.463947:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eae5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237754 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.464188:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eae62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.464205:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eae62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.464218:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eae62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656579.464231:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790656579.464970:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eae5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237754 expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.464990:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eae62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237754 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.464997:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:0.0:1790656579.465012:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656579.465016:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507000, rc 0) 00000100:00100000:0.0:1790656579.465147:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+18:10287:x1877639248769280:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2077us (2429us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790656579.465154:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1790656579.470868:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.471086:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.471162:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769408 00000100:00100000:3.0:1790656579.471172:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769408 00000100:00100000:3.0:1790656579.471261:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656579.471272:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+18:2341:x1877639248769408:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656579.471286:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656579.471308:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eae62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237754 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.471338:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:3.0:1790656579.471342:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656579.471397:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+17:2341:x1877639248769408:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656579.471404:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1790656579.472585:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769664 00000100:00100000:2.0:1790656579.472614:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769664 00000100:00100000:2.0:1790656579.473458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1790656579.473471:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+17:10287:x1877639248769664:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656579.473495:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656579.473525:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eae70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23775b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.478129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.478153:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.478166:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656579.478183:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790656579.478331:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eae70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23775b expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.478351:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23775b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.478360:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656579.478363:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790656579.478367:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656579.478440:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+19:10287:x1877639248769664:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4972us (7580us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790656579.478449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1790656579.491739:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.492218:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769792 00000100:00100000:2.0:1790656579.492227:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769792 00000100:00100000:2.0:1790656579.492405:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1790656579.492429:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248769792:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:2.0:1790656579.492500:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.492520:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 7 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.492528:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656579.492532:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656579.492536:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.492579:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 7 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.492623:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 7 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656579.492637:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269772672:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656579.492728:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656579.494891:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269772672:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656579.494922:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.495444:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656579.495880:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248769920 00000100:00100000:1.0:1790656579.495896:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248769920 00002000:00100000:1.0:1790656579.495971:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff94391f5a2300 x1877639248769920/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:440/0 lens 504/0 e 0 to 0 dl 1790656590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656579.495985:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94391f5a2300 with x1877639248769920 ext(0->12) 00010000:00010000:1.0:1790656579.495995:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656579.496025:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 8 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656579.496034:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94391f5a2300 00000100:00100000:1.0:1790656579.496075:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1790656579.496086:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248769920:12345-192.168.203.23@tcp:4:lfs.0 00000001:00100000:0.0:1790656579.530992:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000100:00100000:3.0:1790656579.532101:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248769920:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 36007us (36648us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790656579.532123:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:3.0:1790656579.532140:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff94391f5a2300 x1877639248769920/t4294967299(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:440/0 lens 504/448 e 0 to 0 dl 1790656590 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656579.532151:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94391f5a2300 with x1877639248769920 ext(0->12) 00010000:00010000:3.0:1790656579.532163:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.532187:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656579.532196:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94391f5a2300 00000100:00100000:1.0:1790656579.535169:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.535463:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248770048 00000100:00100000:0.0:1790656579.535477:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248770048 00010000:00010000:0.0:1790656579.535532:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.535677:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1790656579.535686:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248770048:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656579.535702:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790656579.535722:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790656579.535726:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790656578 00002000:00010000:0.0:1790656579.535728:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790656578 00002000:00010000:0.0:1790656579.535731:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790656578 00010000:00010000:0.0:1790656579.535738:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.535754:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.535805:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001656659f/0x9c3a6e82066eae38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23773f expref: 9 pid: 8825 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.535819:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656579.535823:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656579.535828:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.535836:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.535946:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656579.536014:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248770048:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 328us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656579.536022:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00010000:00010000:2.0:1790656579.536443:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536470:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536504:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536513:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536522:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536530:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656579.536535:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536545:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536561:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.536569:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eae85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656579.536699:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248769792:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 44284us (44968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656579.536709:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1790656579.539802:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.539968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248770304 00000100:00100000:2.0:1790656579.539981:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248770304 00000100:00100000:2.0:1790656579.540037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1790656579.540049:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+19:10287:x1877639248770304:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:2.0:1790656579.540136:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23775b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656579.540484:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1790656579.540531:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1790656579.541316:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1790656579.541392:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.541414:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.541436:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.541482:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.541503:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 23 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656579.541536:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877639269772800:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656579.541696:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d94d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656579.545036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.545182:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877639269772800:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656579.545220:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656579.545299:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248770432 00000100:00100000:3.0:1790656579.545308:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248770432 00010000:00010000:3.0:1790656579.545361:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 24 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656579.545408:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1790656579.545428:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+24:2341:x1877639248770432:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656579.545455:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656579.545463:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 24 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545477:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 24 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eae1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237731 expref: 24 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545521:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:3.0:1790656579.545526:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545537:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545545:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.545575:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656579.545698:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+23:2341:x1877639248770432:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 279us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656579.545706:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00010000:00010000:2.0:1790656579.545888:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.545897:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656579.546058:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1790656579.546309:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1790656579.546449:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269772928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790656579.549515:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656579.549570:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d94780 going to sleep for 11 seconds 00000100:00100000:0.0:1790656579.549661:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269772928 00000100:00100000:0.0:1790656579.549678:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269772928 00000100:00100000:0.0:1790656579.549758:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656579.549769:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877639269772928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790656579.549923:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877639269772928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656579.549930:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790656579.550301:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656579.550477:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269772928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790656579.551480:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790656579.551575:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269773056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790656579.551724:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656579.551759:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d94d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656579.551952:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269773056 00000100:00100000:0.0:1790656579.551962:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269773056 00000100:00100000:0.0:1790656579.552054:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656579.552065:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877639269773056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790656579.552293:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1877639269773056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 230us (570us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790656579.552301:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656579.552369:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269773056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790656579.552442:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1790656579.552485:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552502:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552509:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552515:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656579.552520:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552529:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552547:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656579.552549:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790656579.552554:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.552560:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eae8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790656579.553012:0:5847:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790656579.553263:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790656579.553277:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294689685166ns, next at 295689682204ns, rc = 0 00000001:00080000:2.0:1790656579.553285:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790656579.553322:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656579.553325:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790656579.553334:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eae77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23775b expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656579.553545:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+26:10287:x1877639248770304:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 13497us (13755us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790656579.553555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000020:00080000:2.0:1790656579.553561:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790656579.557019:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.557776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248770560 00000100:00100000:3.0:1790656579.557792:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248770560 00000100:00100000:3.0:1790656579.557927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1790656579.557940:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+26:10287:x1877639248770560:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656579.557997:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.558029:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eae93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237762 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.558106:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237762 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.558124:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237762 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.558147:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656579.558150:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656579.558155:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656579.558240:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+27:10287:x1877639248770560:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 302us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656579.558248:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1790656579.563002:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.563088:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248770816 00000100:00100000:3.0:1790656579.563101:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248770816 00000100:00100000:3.0:1790656579.563178:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1790656579.563190:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+27:10287:x1877639248770816:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656579.563507:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+28:10287:x1877639248770816:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 317us (518us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790656579.563515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1790656579.639247:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.640544:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248771072 00000100:00100000:3.0:1790656579.640562:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248771072 00000100:00100000:3.0:1790656579.640709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1790656579.640731:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+28:10297:x1877639248771072:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656579.640801:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.640829:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eae9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237769 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.640964:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790656579.641118:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eae9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237769 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.641136:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:3.0:1790656579.641140:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656579.641146:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eae9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237769 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.641165:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656579.641254:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+29:10297:x1877639248771072:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 535us (2022us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1790656579.641262:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:1.0:1790656579.649266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.649481:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248771200 00000100:00100000:0.0:1790656579.649495:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248771200 00000100:00100000:0.0:1790656579.649570:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1790656579.649582:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+29:10297:x1877639248771200:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1790656579.649753:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649776:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649790:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649808:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649814:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649820:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649938:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649947:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.649972:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656579.650029:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650044:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650051:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650060:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650066:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656579.650071:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650079:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650092:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:0.0:1790656579.650096:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656579.650113:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650120:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eaea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650135:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650147:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650153:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650158:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656579.650161:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650167:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650175:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94391836d400) 00010000:00010000:0.0:1790656579.650177:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656579.650180:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650185:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaeaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650201:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650207:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650213:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650218:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656579.650227:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650233:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650241:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656579.650243:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656579.650246:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.650253:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eaeb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.650338:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+29:10297:x1877639248771200:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 757us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656579.650346:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1790656579.658175:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.659066:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248771456 00000100:00100000:2.0:1790656579.659087:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248771456 00000100:00100000:2.0:1790656579.659230:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656579.659243:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+29:10297:x1877639248771456:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656579.659583:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+30:10297:x1877639248771456:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 341us (1419us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1790656579.659634:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1790656579.705532:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.706062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248771712 00000100:00100000:3.0:1790656579.706077:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248771712 00000100:00100000:3.0:1790656579.706340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1790656579.706359:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+30:10300:x1877639248771712:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656579.706398:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656579.706439:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eaebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237770 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.706557:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.707077:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.707151:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.708112:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.708130:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.708496:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709029:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709041:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709049:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656579.709063:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790656579.709261:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709269:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709277:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709295:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.709300:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709310:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709325:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656579.709329:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.709334:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709340:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709359:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709366:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709372:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709378:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656579.709381:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709388:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.709407:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3f00) 00010000:00010000:3.0:1790656579.709410:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656579.709414:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.713157:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.713294:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eaebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.713315:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656579.713326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656579.713330:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656579.713335:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656579.713456:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:10300:x1877639248771712:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 7102us (8870us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790656579.713466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1790656579.718029:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.718135:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248771840 00000100:00100000:0.0:1790656579.718148:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248771840 00000100:00100000:0.0:1790656579.718223:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1790656579.718235:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+32:10300:x1877639248771840:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1790656579.718328:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718350:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718363:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718396:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718432:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718439:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718446:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656579.718451:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718459:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718471:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656579.718475:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656579.718480:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.718487:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eaee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656579.718580:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+32:10300:x1877639248771840:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 347us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656579.721249:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1790656579.730374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.740817:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248772096 00000100:00100000:3.0:1790656579.740841:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248772096 00000100:00100000:2.0:1790656579.742312:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1790656579.742329:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+32:10300:x1877639248772096:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656579.742757:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+33:10300:x1877639248772096:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 429us (12396us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790656579.742998:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1790656579.976678:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656579.976986:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248772352 00000100:00100000:2.0:1790656579.976996:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248772352 00000100:00100000:2.0:1790656579.977319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1790656579.977331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+33:10331:x1877639248772352:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1790656579.977356:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656579.977376:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237777 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.977512:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaeee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.977527:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaeee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.977540:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaeee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656579.977551:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790656579.977906:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237777 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.977926:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaeee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237777 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656579.977935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656579.977937:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656579.977941:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656579.978081:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+35:10331:x1877639248772352:12345-192.168.203.23@tcp:101:cat.0 Request processed in 751us (1413us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790656579.978098:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1790656579.981676:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656579.981712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656579.981929:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248772480 00000100:00100000:0.0:1790656579.981939:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248772480 00000100:00100000:0.0:1790656579.982004:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1790656579.982015:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928788050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+35:2339:x1877639248772480:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656579.982046:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656579.982080:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaeee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237777 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656579.982106:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656579.982111:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656579.982540:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928788050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+34:2339:x1877639248772480:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 525us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656579.982549:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1790656579.984421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248772736 00000100:00100000:2.0:1790656579.984434:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248772736 00000100:00100000:2.0:1790656579.984490:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1790656579.984500:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+34:10331:x1877639248772736:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1790656579.987584:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+35:10331:x1877639248772736:12345-192.168.203.23@tcp:35:cat.0 Request processed in 3077us (5863us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790656579.987638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656580.067312:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.067454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248772992 00000100:00100000:3.0:1790656580.067478:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248772992 00000100:00100000:3.0:1790656580.067553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1790656580.067565:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+35:10337:x1877639248772992:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1790656580.067653:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656580.067658:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790656580.067696:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eae54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23774d expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.067735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656580.067741:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656580.067760:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaefc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23777e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.067918:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.067937:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.067946:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.067987:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.068003:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 35 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656580.068018:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269773184:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656580.068152:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656580.071799:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.072101:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269773184:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656580.072159:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.073184:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248773120 00000100:00100000:2.0:1790656580.073197:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248773120 00010000:00010000:2.0:1790656580.073256:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 36 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.073339:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1790656580.073353:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+36:2341:x1877639248773120:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656580.073373:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656580.073382:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 36 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073396:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 36 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073437:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237770 expref: 36 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073457:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656580.073463:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073474:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073825:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.073971:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656580.074053:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+35:2341:x1877639248773120:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 702us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656580.074062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00010000:00010000:3.0:1790656580.075839:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.075857:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656580.075889:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790656580.076891:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaefc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.076990:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.077000:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.077003:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790656580.077008:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96200, rc 0) 00000100:00100000:3.0:1790656580.077172:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+35:10337:x1877639248772992:12345-192.168.203.23@tcp:101:dd.0 Request processed in 9608us (9874us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790656580.077182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1790656580.080742:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.081096:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248773376 00000100:00100000:3.0:1790656580.081109:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248773376 00000100:00100000:3.0:1790656580.081187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1790656580.081198:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+35:10337:x1877639248773376:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:3.0:1790656580.081581:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.081958:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.081971:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790656580.082061:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1790656580.082094:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a40e80e4 reply state 000000002591a25b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656580.082105:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656580.082224:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+38:10337:x1877639248773376:12345-192.168.203.23@tcp:36:dd.0 Request processed in 1026us (1493us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790656580.082234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000020:00080000:3.0:1790656580.082241:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790656580.089362:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089386:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089395:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089402:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656580.089408:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089428:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089779:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.089784:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656580.089791:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.089799:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.318946:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656580.377517:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656580.377904:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248773504 00000100:00100000:0.0:1790656580.377919:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248773504 00000100:00100000:0.0:1790656580.378002:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1790656580.378016:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+37:10351:x1877639248773504:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:0.0:1790656580.378073:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656580.378100:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eaf18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237785 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378187:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378205:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378219:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378236:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378554:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.378562:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.379083:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.379102:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.379112:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.379161:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.379180:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 38 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656580.379197:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269773312:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656580.379854:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656580.387640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656580.388195:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269773312:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656580.388215:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248773760 00000100:00100000:3.0:1790656580.388226:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248773760 00010000:00010000:0.0:1790656580.388232:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656580.388299:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656580.388310:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+39:5580:x1877639248773760:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790656580.388781:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+40:5580:x1877639248773760:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 470us (1154us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1790656580.388790:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1790656580.394539:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656580.394710:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248773888 00000100:00100000:0.0:1790656580.394751:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248773888 00010000:00010000:0.0:1790656580.394803:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 40 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656580.394855:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1790656580.394867:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+40:2342:x1877639248773888:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656580.394885:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656580.394893:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 40 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.394919:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 40 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.394948:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23777e expref: 40 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.394970:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656580.394977:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.394989:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.394999:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.395044:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656580.395123:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+39:2342:x1877639248773888:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 258us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656580.395142:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00010000:00010000:2.0:1790656580.395385:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395396:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656580.395465:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790656580.395471:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656580.395527:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395542:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395554:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395562:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395570:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395577:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656580.395582:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395642:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395654:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656580.395658:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656580.395662:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395668:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eaf1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395682:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395687:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395692:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395697:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656580.395700:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395705:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395722:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94391836d400) 00010000:00010000:2.0:1790656580.395725:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656580.395728:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395745:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eaf26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395792:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eaf18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237785 expref: 39 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395808:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237785 expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.395815:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656580.395817:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656580.395820:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506600, rc 0) 00000100:00100000:2.0:1790656580.395872:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+38:10351:x1877639248773504:12345-192.168.203.23@tcp:101:stat.0 Request processed in 17859us (18369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656580.395880:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1790656580.500499:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656580.500905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248774144 00000100:00100000:2.0:1790656580.500920:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248774144 00000100:00100000:2.0:1790656580.501068:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:2.0:1790656580.501081:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+38:10358:x1877639248774144:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:2.0:1790656580.501159:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656580.501193:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eaf2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237785 expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.501219:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656580.501226:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656580.501508:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.501537:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.501548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656580.501947:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790656580.501977:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b090426 reply state 000000004ad3940e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.501987:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656580.502202:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+40:10358:x1877639248774144:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 1122us (1717us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790656580.502211:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000020:00080000:2.0:1790656580.502217:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790656580.505982:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506004:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506012:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506019:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656580.506024:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506069:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506091:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.506094:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656580.506102:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.506109:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656580.674515:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.674875:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248774272 00000100:00100000:3.0:1790656580.674892:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248774272 00000100:00100000:3.0:1790656580.674985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1790656580.674998:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+39:10372:x1877639248774272:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:3.0:1790656580.675049:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656580.675080:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23778c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675177:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675195:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675226:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675257:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675264:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675379:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675389:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675397:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656580.675449:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790656580.675455:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656580.675484:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675497:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675506:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675513:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675520:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675539:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656580.675543:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675552:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675567:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656580.675571:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656580.675577:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675584:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eaf42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675652:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675660:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675667:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675673:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656580.675676:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675683:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675702:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3f00) 00010000:00010000:3.0:1790656580.675705:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656580.675708:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675726:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675766:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675781:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.675789:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.675792:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656580.675794:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656580.675884:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+40:10372:x1877639248774272:12345-192.168.203.23@tcp:101:stat.0 Request processed in 888us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656580.675893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1790656580.768220:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.773849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248774528 00000100:00100000:3.0:1790656580.773864:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248774528 00000100:00100000:3.0:1790656580.776356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1790656580.777692:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+40:10382:x1877639248774528:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656580.777714:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656580.777736:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237793 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656580.779867:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790656580.780016:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237793 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.780030:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:3.0:1790656580.780033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656580.780038:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237793 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.780052:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656580.780123:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+41:10382:x1877639248774528:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2450us (11911us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1790656580.780133:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1790656580.789477:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656580.790449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248774784 00000100:00100000:2.0:1790656580.790465:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248774784 00000100:00100000:2.0:1790656580.790553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1790656580.790566:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+41:10382:x1877639248774784:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656580.791202:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+42:10382:x1877639248774784:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 636us (1737us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790656580.791211:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1790656580.873309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.873452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775040 00000100:00100000:3.0:1790656580.873465:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775040 00000100:00100000:3.0:1790656580.873544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1790656580.873557:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+42:10388:x1877639248775040:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656580.873827:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656580.873856:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23779a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.873990:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.874007:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.874181:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.874228:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.874244:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 43 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656580.874260:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269773440:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656580.874380:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656580.878125:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656580.878298:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775168 00000100:00100000:2.0:1790656580.878310:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775168 00010000:00010000:2.0:1790656580.878366:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 44 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.878431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656580.878461:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+44:2341:x1877639248775168:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656580.878480:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656580.878488:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 44 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.878504:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 44 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.878536:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656580.878542:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.878553:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.878574:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.878661:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656580.878729:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+44:2341:x1877639248775168:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 271us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656580.878738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00010000:00010000:3.0:1790656580.879077:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eaf50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23778c expref: 43 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656580.879097:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269773440:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656580.879126:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.879136:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.879143:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656580.879166:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1790656580.879354:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eaf65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.879390:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.879399:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.879402:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790656580.879405:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96c00, rc 0) 00000100:00100000:3.0:1790656580.879457:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+43:10388:x1877639248775040:12345-192.168.203.23@tcp:101:bash.0 Request processed in 5902us (6162us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1790656580.879465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:0.0:1790656580.891299:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656580.891885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775424 00000100:00100000:1.0:1790656580.891900:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775424 00000100:00100000:1.0:1790656580.891984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1790656580.891998:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+43:10388:x1877639248775424:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:1.0:1790656580.893302:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656580.893329:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656580.893365:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790656580.893445:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1790656580.893475:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d7bc6ec reply state 000000005a65972a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656580.893486:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790656580.896179:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+46:10388:x1877639248775424:12345-192.168.203.23@tcp:36:bash.0 Request processed in 4167us (4877us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1790656580.896195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000020:00080000:1.0:1790656580.896206:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790656580.904377:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904401:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904421:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904428:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656580.904434:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904445:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904466:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656580.904469:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656580.904475:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656580.904509:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eaf7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656580.911574:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656580.912431:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775552 00000100:00100000:2.0:1790656580.912446:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775552 00000100:00100000:2.0:1790656580.912528:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1790656580.912541:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+45:10388:x1877639248775552:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656580.912576:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656580.912705:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaf81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377a1 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.913119:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.913138:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.913149:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.913196:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.913212:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 46 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.913228:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269773568:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656580.913350:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656580.919529:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656580.919682:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775680 00000100:00100000:0.0:1790656580.919695:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775680 00010000:00010000:0.0:1790656580.919748:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 47 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656580.919890:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269773568:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656580.920109:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656580.920158:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1790656580.920170:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+47:2342:x1877639248775680:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656580.920189:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656580.920198:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 47 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920212:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 47 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920239:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eaf6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23779a expref: 47 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920256:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656580.920261:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920272:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920304:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656580.920339:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656580.920459:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+46:2342:x1877639248775680:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 291us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656580.920467:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00010000:00010000:2.0:1790656580.920620:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.920628:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656580.920685:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790656580.920700:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656580.920729:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.920765:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaf81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377a1 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.920780:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377a1 expref: 45 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656580.920787:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656580.920789:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656580.920792:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656580.920826:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+45:10388:x1877639248775552:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8289us (9268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656580.920833:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:1.0:1790656580.925542:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656580.926554:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248775936 00000100:00100000:3.0:1790656580.926574:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248775936 00000100:00100000:2.0:1790656580.927557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1790656580.927574:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+45:10388:x1877639248775936:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1790656580.928520:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+46:10388:x1877639248775936:12345-192.168.203.23@tcp:35:bash.0 Request processed in 941us (2985us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1790656580.928531:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1790656581.020855:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.021215:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248776192 00000100:00100000:2.0:1790656581.021229:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248776192 00000100:00080000:1.0:1790656581.021383:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656581.021423:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:2.0:1790656581.021437:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+46:10398:x1877639248776192:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656581.021474:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656581.021502:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaf8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377a8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656581.021694:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790656581.021844:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaf8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377a8 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.021862:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:2.0:1790656581.021865:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656581.021871:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaf8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377a8 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.021888:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481e00, rc 0) 00000100:00100000:2.0:1790656581.021970:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+47:10398:x1877639248776192:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 536us (1130us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790656581.021978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:1.0:1790656581.025077:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.025210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248776320 00000100:00100000:2.0:1790656581.025222:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248776320 00000100:00100000:2.0:1790656581.025293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1790656581.025306:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+47:10398:x1877639248776320:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656581.026212:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026239:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026319:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026340:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026367:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026506:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026718:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026728:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026736:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656581.026794:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026875:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026955:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.026963:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.027036:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.027041:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.027050:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.027072:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656581.027076:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.028161:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028180:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eaf9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028203:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028210:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028216:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028221:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.028225:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028231:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028244:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4ab00) 00010000:00010000:2.0:1790656581.028247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.028250:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.028325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.032924:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.032959:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.032968:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.032976:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.032981:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.032992:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.033029:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656581.033033:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.033040:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.033047:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eafab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.033200:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+47:10398:x1877639248776320:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 7891us (8138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.033890:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1790656581.036257:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.039141:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248776576 00000100:00100000:1.0:1790656581.039161:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248776576 00000100:00100000:1.0:1790656581.040888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656581.040919:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+47:10398:x1877639248776576:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656581.041262:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+48:10398:x1877639248776576:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 360us (5020us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1790656581.041270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656581.089521:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.089802:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248776832 00000100:00100000:3.0:1790656581.089816:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248776832 00000100:00100000:3.0:1790656581.089888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1790656581.089900:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+48:10401:x1877639248776832:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656581.089932:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656581.089957:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eafb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377af expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090054:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090071:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090085:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090125:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090142:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090314:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eafc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090324:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eafc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.090332:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eafc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656581.090343:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790656581.091843:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.091932:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.091942:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.091949:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.091955:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.091969:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.091988:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656581.091992:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.091998:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092029:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eafb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092047:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092053:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092059:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092064:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.092067:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092072:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3f00) 00010000:00010000:3.0:1790656581.092082:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.092085:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092353:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eafc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092440:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eafb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377af expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092457:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eafc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377af expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.092473:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.092476:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656581.092479:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656581.092576:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+50:10401:x1877639248776832:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2677us (3069us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1790656581.092972:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:0.0:1790656581.095491:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.095778:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.095988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248776960 00000100:00100000:3.0:1790656581.096003:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248776960 00000100:00100000:0.0:1790656581.096094:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248777088 00000100:00100000:0.0:1790656581.096099:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248777088 00000100:00100000:0.0:1790656581.096151:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1790656581.096162:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+51:2342:x1877639248777088:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656581.096181:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656581.096214:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eafc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377af expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.096236:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:0.0:1790656581.096242:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656581.096263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:3.0:1790656581.096277:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+50:10401:x1877639248776960:12345-192.168.203.23@tcp:54:lfs.0 00000100:00100000:0.0:1790656581.096310:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+50:2342:x1877639248777088:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 148us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.096318:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00010000:00010000:3.0:1790656581.096354:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096372:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096425:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096434:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096441:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096448:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.096472:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096481:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096491:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.096494:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656581.096498:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.096505:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eafd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.096548:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+49:10401:x1877639248776960:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 276us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.096555:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1790656581.099836:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.099951:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248777344 00000100:00100000:2.0:1790656581.099963:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248777344 00000100:00100000:2.0:1790656581.100042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1790656581.100054:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+49:10401:x1877639248777344:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656581.100363:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+50:10401:x1877639248777344:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 310us (542us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790656581.100381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1790656581.252777:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.255924:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248777600 00000100:00100000:2.0:1790656581.255945:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248777600 00000100:00100000:2.0:1790656581.256315:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:2.0:1790656581.256329:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+50:10419:x1877639248777600:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1790656581.256366:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656581.256392:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377b6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.256621:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eafe3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.256640:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eafe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.256655:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eafe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656581.256670:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790656581.256831:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377b6 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.256856:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eafe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377b6 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.256888:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656581.256891:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790656581.256896:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656581.257502:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+52:10419:x1877639248777600:12345-192.168.203.23@tcp:101:cat.0 Request processed in 1174us (5010us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790656581.257512:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1790656581.284203:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.284328:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248777728 00000100:00100000:2.0:1790656581.284341:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248777728 00000100:00100000:2.0:1790656581.284429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:2.0:1790656581.284441:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:10420:x1877639248777728:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656581.284477:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656581.284503:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284647:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284664:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284678:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656581.284847:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790656581.284852:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656581.284876:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284934:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eaff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377bd expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284956:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377bd expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.284966:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656581.284969:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656581.284974:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481e00, rc 0) 00000100:00100000:2.0:1790656581.285046:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+53:10420:x1877639248777728:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 607us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.285054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:0.0:1790656581.292492:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.293870:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778112 00000100:00100000:2.0:1790656581.293901:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778112 00000100:00100000:2.0:1790656581.293995:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1790656581.294008:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+53:10420:x1877639248778112:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656581.295032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+54:10420:x1877639248778112:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 1018us (2547us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790656581.295044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1790656581.299164:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.299792:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778240 00000100:00100000:3.0:1790656581.299808:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778240 00000100:00100000:3.0:1790656581.299901:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656581.299914:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+54:10420:x1877639248778240:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1790656581.299934:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790656581.299966:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eaf88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377a1 expref: 54 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.299994:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eafe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377b6 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.300009:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eae93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237762 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.300036:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.300049:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656581.300185:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+51:10420:x1877639248778240:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 273us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.300194:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1790656581.308113:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.308496:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778368 00000100:00100000:2.0:1790656581.308509:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778368 00000100:00100000:2.0:1790656581.308586:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:2.0:1790656581.308623:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+51:10420:x1877639248778368:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:2.0:1790656581.308783:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.308816:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.308830:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656581.309201:0:6714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656581.309482:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790656581.309566:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790656581.309736:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+51:10420:x1877639248778368:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 1112us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.309747:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:1.0:1790656581.339686:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.339852:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778496 00000100:00100000:3.0:1790656581.339865:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778496 00000100:00100000:3.0:1790656581.339953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1790656581.339967:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+51:10422:x1877639248778496:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656581.339992:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656581.340017:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377c4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340097:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340115:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340127:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340143:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340148:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340167:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340277:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340286:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340294:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656581.340340:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790656581.340346:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656581.340370:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340383:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340393:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340400:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340420:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.340431:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340463:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656581.340467:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.340472:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340479:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340494:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340500:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340506:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340511:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.340514:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340519:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340525:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3900) 00010000:00010000:3.0:1790656581.340528:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.340531:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340547:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340969:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340990:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.340998:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:3.0:1790656581.341001:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656581.341004:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96200, rc 0) 00000100:00100000:3.0:1790656581.341083:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+52:10422:x1877639248778496:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1118us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.341091:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000040:00080000:1.0:1790656581.343781:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656581.343793:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656581.343859:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790656581.343868:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790656581.344032:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269773696:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790656581.344174:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439089dfe40 going to sleep for 11 seconds 00010000:00010000:0.0:1790656581.344474:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656581.350153:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.350671:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269773696:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790656581.352507:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778624 00000100:00100000:3.0:1790656581.352524:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778624 00000100:00100000:3.0:1790656581.352641:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656581.352654:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778624:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790656581.352753:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778624:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 102us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.352762:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1790656581.360664:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656581.360736:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778752 00000100:00100000:0.0:1790656581.360750:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778752 00000100:00100000:0.0:1790656581.360826:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1790656581.360842:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778752:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790656581.360914:0:6714:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790656581.361086:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778752:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 246us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.361101:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1790656581.365744:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.365970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248778880 00000100:00100000:2.0:1790656581.365984:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248778880 00000100:00100000:2.0:1790656581.366114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1790656581.366126:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778880:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790656581.366222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.366243:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.366257:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367830:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367855:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367884:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367920:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367929:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.367936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656581.367976:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790656581.367980:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656581.367994:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368229:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368236:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368244:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368249:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.368254:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368262:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:2.0:1790656581.368285:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.368290:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368297:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb022 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368312:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368317:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368322:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368327:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.368330:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368336:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368343:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff943909b4a400) 00010000:00010000:2.0:1790656581.368346:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.368348:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368354:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb029 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368452:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368459:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368465:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368471:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.368474:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368480:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368488:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656581.368491:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656581.368494:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.368499:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.368774:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248778880:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 2645us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.368793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1790656581.379235:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.379384:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248779136 00000100:00100000:3.0:1790656581.379415:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248779136 00000100:00100000:3.0:1790656581.379543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1790656581.379562:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+52:10424:x1877639248779136:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656581.380021:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656581.380053:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb037 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377cb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.380235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.380258:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.380275:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656581.380291:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790656581.380460:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381260:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381271:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381280:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.381857:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381874:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:3.0:1790656581.381925:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656581.381935:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.381944:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb03e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.382033:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb037 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377cb expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.382048:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:3.0:1790656581.382051:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656581.382056:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb037 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377cb expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.382070:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656581.382210:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779136:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2653us (2982us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790656581.382222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1790656581.390127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.390445:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248779264 00000100:00100000:3.0:1790656581.390462:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248779264 00000100:00100000:3.0:1790656581.390573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:3.0:1790656581.390685:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779264:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790656581.390754:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790656581.390926:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779264:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 341us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.390934:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1790656581.400887:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.401015:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248779520 00000100:00100000:2.0:1790656581.401030:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248779520 00000100:00100000:2.0:1790656581.401114:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:2.0:1790656581.401125:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790656581.401146:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656581.401149:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790656581.401174:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eaff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377bd expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.401194:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656581.401199:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656581.401212:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb04c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377d2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656581.403085:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1790656581.404990:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.405023:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.405042:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.405151:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb04c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d2 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.405198:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d2 expref: 54 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.405210:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.405215:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656581.405219:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656581.405355:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:10424:x1877639248779520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4228us (4480us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1790656581.405369:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:2.0:1790656581.419885:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.420086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248779776 00000100:00100000:3.0:1790656581.420102:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248779776 00000100:00100000:3.0:1790656581.420262:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:3.0:1790656581.420278:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+54:10424:x1877639248779776:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790656581.420388:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656581.420441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d2 expref: 54 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.420497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.420513:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656581.420549:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.420569:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.420583:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430075:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430110:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430124:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430199:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430207:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430215:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430221:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.430226:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430247:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656581.430262:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.430267:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430273:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb061 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430286:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430292:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430298:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430303:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.430306:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430312:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430319:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf5e1aca2 (ffff9439086c3f00) 00010000:00010000:3.0:1790656581.430321:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.430324:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.430342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb068 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf5e1aca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.430850:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779776:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 10572us (10974us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790656581.430860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:0.0:1790656581.433380:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.433460:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248779904 00000100:00100000:3.0:1790656581.433473:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248779904 00000100:00100000:3.0:1790656581.433551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:3.0:1790656581.433564:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+53:10424:x1877639248779904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656581.433585:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656581.433650:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb06f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377d9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433681:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433695:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433704:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433794:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb06f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433814:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.433836:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.433839:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790656581.433842:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:2.0:1790656581.433980:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+54:10424:x1877639248779904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 413us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.433992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:0.0:1790656581.446912:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.447217:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248780160 00000100:00100000:1.0:1790656581.447232:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248780160 00000100:00100000:1.0:1790656581.447310:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:1.0:1790656581.447322:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+54:10424:x1877639248780160:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790656581.447470:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.447493:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.447507:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790656581.448203:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1790656581.448216:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296584624061ns, next at 297584621359ns, rc = 0 00000004:00010000:1.0:1790656581.448334:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061237fa1 reply state 00000000c0a4cbee transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.448347:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790656581.449071:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:10424:x1877639248780160:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 1745us (2182us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1790656581.449083:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00010000:00010000:3.0:1790656581.453793:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453817:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453826:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453833:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.453840:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453849:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453870:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.453874:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790656581.453879:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.453886:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb07d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.454054:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.454308:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248780288 00000100:00100000:1.0:1790656581.454322:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248780288 00000100:00100000:1.0:1790656581.454452:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:1.0:1790656581.454474:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+55:10424:x1877639248780288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656581.454505:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656581.454526:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377e0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.454633:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.454648:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.454669:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:1.0:1790656581.454672:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656581.454674:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cfe00, rc 0) 00000100:00100000:1.0:1790656581.454734:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:10424:x1877639248780288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 264us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.454741:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:0.0:1790656581.460537:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.460737:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248780416 00000100:00100000:1.0:1790656581.460751:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248780416 00000100:00100000:1.0:1790656581.460812:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1790656581.460822:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2338:x1877639248780416:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790656581.460865:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:1.0:1790656581.460909:0:6690:0:(genops.c:1384:class_connect()) connect: client 177b5748-b800-471f-9375-621ebde8193b, cookie 0x9c3a6e82066eb08b 00002000:00100000:1.0:1790656581.460923:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 177b5748-b800-471f-9375-621ebde8193b/ffff94390783a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790656581.460969:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790656581.461264:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790656581.461305:0:6690:0:(import.c:65:import_set_state_nolock()) ffff943907839800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656581.461388:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2338:x1877639248780416:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 Request processed in 565us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.461398:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1790656581.465687:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.466629:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248780544 00000100:00100000:3.0:1790656581.466647:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248780544 00000100:00100000:3.0:1790656581.466742:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1790656581.466762:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+6:0:x1877639248780544:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790656581.467031:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1790656581.523937:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000001:00080000:3.0:1790656581.523962:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1790656581.524152:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:0:x1877639248780544:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 57386us (58472us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790656581.524164:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1790656581.526519:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.526803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248780800 00000100:00100000:1.0:1790656581.526817:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248780800 00000100:00100000:1.0:1790656581.526882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1790656581.526895:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+56:10424:x1877639248780800:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790656581.527194:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+57:10424:x1877639248780800:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 301us (688us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790656581.527203:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656581.530045:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.530121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781056 00000100:00100000:3.0:1790656581.530133:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781056 00000100:00100000:3.0:1790656581.530204:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656581.530215:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:10424:x1877639248781056:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790656581.530347:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:10424:x1877639248781056:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.530354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656581.532314:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.532422:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781184 00000100:00100000:2.0:1790656581.532435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781184 00000100:00100000:2.0:1790656581.532542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1790656581.532553:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:10424:x1877639248781184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790656581.532578:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656581.532682:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377e7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532782:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532799:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656581.532858:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656581.532882:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532929:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e7 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532945:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e7 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.532954:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656581.532958:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790656581.532961:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656581.533136:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+58:10424:x1877639248781184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 583us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.533145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1790656581.535512:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.535587:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781312 00000100:00100000:1.0:1790656581.535774:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781312 00000100:00100000:1.0:1790656581.535927:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1790656581.535939:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248781312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656581.535962:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656581.535990:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377ee expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656581.536021:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abb4044, blocks: 0x1 00010000:00010000:1.0:1790656581.536046:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1790656581.536052:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656581.536061:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.536096:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.536111:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cea00, rc 0) 00000100:00100000:1.0:1790656581.536182:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248781312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 245us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.536189:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1790656581.543412:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656581.543544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781568 00000100:00100000:0.0:1790656581.543558:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781568 00000100:00100000:0.0:1790656581.543686:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1790656581.543699:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+58:10424:x1877639248781568:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790656581.543842:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+58:10424:x1877639248781568:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 146us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.543851:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:2.0:1790656581.546797:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.546940:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781696 00000100:00100000:1.0:1790656581.546953:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781696 00000100:00100000:1.0:1790656581.547022:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1790656581.547033:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:10424:x1877639248781696:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656581.547056:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656581.547082:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377f5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.547122:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.547133:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656581.547138:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656581.547144:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.547189:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.547213:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 7 pid: 6690 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.547229:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1877639269773824:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656581.547339:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439089dfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656581.552065:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656581.552171:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781824 00000100:00100000:0.0:1790656581.552182:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781824 00010000:00010000:0.0:1790656581.552236:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 8 pid: 6690 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.552286:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1790656581.552298:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248781824:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656581.552315:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656581.552344:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 8 pid: 6690 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.552361:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 8 pid: 6690 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.552397:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656581.552415:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656581.552427:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.552439:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.552489:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.552509:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377ee expref: 8 pid: 6690 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.552513:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fa81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269773952:192.168.203.23@tcp:105: 00000100:00100000:1.0:1790656581.552529:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1877639269773824:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656581.552570:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.552618:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce800, rc 0) 00000100:00100000:1.0:1790656581.552655:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:10424:x1877639248781696:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 5623us (5867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.552663:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656581.552666:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1790656581.555465:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fa81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269773952:192.168.203.23@tcp:105: 00010000:00010000:1.0:1790656581.555501:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656581.555571:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248781824:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3274us (3520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.555618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1790656581.558960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.559329:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248781952 00000100:00100000:1.0:1790656581.559342:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248781952 00002000:00100000:1.0:1790656581.559429:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94393bb38000 x1877639248781952/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:442/0 lens 504/0 e 0 to 0 dl 1790656592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656581.559442:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393bb38000 with x1877639248781952 ext(0->8) 00002000:00010000:1.0:1790656581.559449:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393bb38000 00000100:00100000:1.0:1790656581.559486:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1790656581.559497:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248781952:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790656581.561762:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248781952:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 2255us (2806us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790656581.561777:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:1.0:1790656581.561791:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94393bb38000 x1877639248781952/t4294967302(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:442/0 lens 504/448 e 0 to 0 dl 1790656592 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656581.561802:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393bb38000 with x1877639248781952 ext(0->8) 00002000:00010000:1.0:1790656581.561810:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393bb38000 00000100:00100000:1.0:1790656581.565211:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656581.565302:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782080 00000100:00100000:0.0:1790656581.565314:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782080 00000100:00100000:0.0:1790656581.565386:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:0.0:1790656581.565399:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+58:10424:x1877639248782080:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790656581.633491:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+58:10424:x1877639248782080:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 68080us (68281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.633504:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000001:00080000:3.0:1790656581.633611:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000001:00080000:3.0:1790656581.633623:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1790656581.633633:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1790656581.633684:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1790656581.633701:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943932d94780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1790656581.633714:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943932d949c0 00000020:00080000:3.0:1790656581.633718:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943935854800 00000020:00080000:3.0:1790656581.633893:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1790656581.634032:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1790656581.634054:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269774080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790656581.634133:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656581.634185:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269774080 00000100:00100000:1.0:1790656581.634194:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269774080 00000100:00100000:1.0:1790656581.634260:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790656581.634270:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269774080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790656581.634300:0:8825:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1790656581.634344:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abb4042, atime: 0x6abb4042, ctime: 0x6abb4042, blocks: 0x1 00010000:00010000:1.0:1790656581.634354:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.634375:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1790656581.634380:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656581.634394:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.634424:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790656581.634427:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790656581.634437:0:8825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.634439:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269774208:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790656581.634446:0:8825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.634464:0:8825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790656581.634471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656581.636158:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269774208 00000100:00100000:2.0:1790656581.636176:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269774208 00010000:00010000:3.0:1790656581.636338:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656581.636350:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.636376:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cea00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656581.636382:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.636393:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.636429:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.636437:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad2f537/0x9c3a6e82066eb0ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.636466:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656581.636468:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656581.636469:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656581.636721:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790656581.636733:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269774208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790656581.636912:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790656581.636916:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790656580 00002000:00010000:2.0:1790656581.636919:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790656581.636921:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790656580 -> 1790656580 00002000:00010000:2.0:1790656581.636923:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790656581.637014:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269774208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (2541us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790656581.637022:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1790656581.637089:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94393fa83100/2, rc 0, transno 4294967303 00000100:00100000:2.0:1790656581.637096:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269774208:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1790656581.637374:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656581.637725:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1877639269774080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3454us (3588us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790656581.637736:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1790656581.637925:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94393bb39180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1790656581.637933:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269774080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790656581.638131:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.638224:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782208 00000100:00100000:3.0:1790656581.638232:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782208 00000100:00100000:3.0:1790656581.638323:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1790656581.638335:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248782208:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790656581.677107:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1790656581.677163:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1790656581.677304:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248782208:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 38964us (39168us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.677317:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:2.0:1790656581.693281:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.693412:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782464 00000100:00100000:3.0:1790656581.693424:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782464 00000100:00100000:3.0:1790656581.693498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1790656581.693510:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+13:10424:x1877639248782464:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790656581.693575:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656581.693649:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.693675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.693681:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656581.693728:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.693745:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.693756:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656581.696554:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab02146a reply state 000000000ea3005c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.696578:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656581.696797:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+14:10424:x1877639248782464:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 3284us (3526us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790656581.696828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:3.0:1790656581.699745:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699769:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699779:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699786:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656581.699791:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699800:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699820:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.699824:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656581.699829:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.699836:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb0b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.700252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.700349:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782592 00000100:00100000:1.0:1790656581.700362:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782592 00000100:00100000:1.0:1790656581.700484:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1790656581.700497:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248782592:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790656581.700861:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790656581.700866:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790656580 -> 1790656580 00002000:00010000:1.0:1790656581.700868:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790656578 00002000:00010000:1.0:1790656581.700871:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790656580 -> 1790656580 00002000:00010000:1.0:1790656581.700873:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790656581.700962:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2339:x1877639248782592:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 466us (714us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790656581.700990:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1790656581.703964:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.704208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782848 00000100:00100000:1.0:1790656581.704223:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782848 00000100:00100000:1.0:1790656581.704295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1790656581.704307:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+13:10424:x1877639248782848:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790656581.704398:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.704434:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.704444:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.704489:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.704505:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.704521:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269774336:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656581.704883:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928519300 going to sleep for 11 seconds 00000100:00100000:3.0:1790656581.714654:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.714700:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248782976 00000100:00100000:3.0:1790656581.714713:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248782976 00010000:00010000:3.0:1790656581.714760:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 14 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.714823:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1790656581.714835:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+14:2342:x1877639248782976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656581.714853:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656581.714862:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 14 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.714876:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 14 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.714906:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:3.0:1790656581.714911:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.714922:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.714931:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.714955:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656581.715015:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+14:2342:x1877639248782976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 182us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.715023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00010000:00010000:2.0:1790656581.716717:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377d9 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.716749:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269774336:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656581.716782:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716794:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716823:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716860:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716869:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716878:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716885:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.716890:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716897:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716916:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656581.716920:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790656581.716926:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.716932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb0bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.717082:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+12:10424:x1877639248782848:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 12776us (13131us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790656581.717094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:3.0:1790656581.740069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.740218:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248783104 00000100:00100000:2.0:1790656581.740232:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248783104 00000100:00100000:2.0:1790656581.740306:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1790656581.740318:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2339:x1877639248783104:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790656581.740383:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.740417:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.740428:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656581.740434:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656581.740439:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.740483:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.740500:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.740518:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269774464:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656581.740644:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d9e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790656581.753743:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.753826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248783232 00000100:00100000:1.0:1790656581.753838:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248783232 00010000:00010000:1.0:1790656581.753890:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.753961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:1.0:1790656581.753973:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248783232:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656581.753992:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656581.754020:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.754036:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 8 pid: 6692 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.754069:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656581.754076:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656581.754082:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.754093:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.754130:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656581.754198:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248783232:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 227us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.754207:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00010000:00010000:0.0:1790656581.754673:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009593c593/0x9c3a6e82066eb0a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377f5 expref: 7 pid: 6692 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.754696:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269774464:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656581.754724:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754736:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754743:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754776:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754795:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754804:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754813:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656581.754818:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754829:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754845:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.754853:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda9d413/0x9c3a6e82066eb0c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.754923:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248783104:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 14607us (14868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656581.754932:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:1.0:1790656581.759429:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656581.759531:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248783488 00000100:00100000:2.0:1790656581.759545:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248783488 00000100:00100000:2.0:1790656581.759640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:2.0:1790656581.759654:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+12:10424:x1877639248783488:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790656581.759772:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.759795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.759810:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.760083:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.760096:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.760106:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.760147:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.760163:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 13 pid: 6714 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.760178:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269774592:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656581.760408:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d9e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790656581.773829:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656581.773883:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248783616 00000100:00100000:1.0:1790656581.773897:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248783616 00010000:00010000:1.0:1790656581.773965:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 14 pid: 6714 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.774021:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1790656581.774034:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+14:2341:x1877639248783616:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656581.774568:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656581.774617:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 14 pid: 6714 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.774639:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 14 pid: 6714 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.774669:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:1.0:1790656581.774677:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.774688:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.774697:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.774780:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377e0 expref: 14 pid: 6714 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.774882:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269774592:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656581.774911:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.774922:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656581.774922:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656581.774931:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656581.774996:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+13:2341:x1877639248783616:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 963us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.775009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000001:00080000:3.0:1790656581.780527:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1790656581.781227:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1790656581.781288:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1790656581.782137:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1877639269774720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790656581.782226:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656581.782273:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656581.784978:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269774720 00000100:00100000:2.0:1790656581.784999:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269774720 00000100:00100000:2.0:1790656581.785072:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656581.785084:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877639269774720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790656581.785487:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877639269774720:12345-0@lo:1000:mdt00_002.0 Request processed in 404us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.785496:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656581.790224:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790656581.790243:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94393fa83100, transno 4294967303 00000100:00100000:3.0:1790656581.790325:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1877639269774720:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1790656581.790995:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790656581.791117:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1877639269774848:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790656581.791218:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656581.791254:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38180 going to sleep for 11 seconds 00000100:00100000:2.0:1790656581.793463:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269774976:0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.793563:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656581.793642:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656581.793649:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269775360:0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.793681:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656581.793715:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269775104:0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.793739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656581.793755:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656581.793760:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269775232:0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.793782:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656581.793818:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269774976 00000100:00100000:2.0:1790656581.793828:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269774976 00000100:00100000:2.0:1790656581.793884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790656581.793895:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269774976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.793950:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269774976:12345-0@lo:400:kworker.0 Request processed in 56us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.793957:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790656581.793993:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269775360 00000100:00100000:2.0:1790656581.793997:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269775360 00000100:00100000:2.0:1790656581.794028:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269775104 00000100:00100000:2.0:1790656581.794031:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269775104 00000100:00100000:2.0:1790656581.794044:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269775232 00000100:00100000:2.0:1790656581.794047:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269775232 00000100:00100000:2.0:1790656581.794066:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790656581.794081:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269775360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.794396:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269775360:12345-0@lo:400:kworker.0 Request processed in 315us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.794414:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790656581.794431:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790656581.794438:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269775104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.794527:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269775104:12345-0@lo:400:kworker.0 Request processed in 89us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.794534:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790656581.794546:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790656581.794552:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269775232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656581.794576:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269775232:12345-0@lo:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656581.794581:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1790656581.794628:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656581.794637:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656581.794647:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656581.794679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656581.794712:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269775488 00000100:00100000:1.0:1790656581.794717:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269775488 00000100:00100000:2.0:1790656581.794740:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269775360:0@lo:400:kworker.0 00000100:00100000:1.0:1790656581.794749:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790656581.794752:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269774976:0@lo:400:kworker.0 00000100:00100000:1.0:1790656581.794762:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269775488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656581.794797:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656581.794798:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269774848 00000100:00100000:2.0:1790656581.794802:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269774848 00000100:00100000:2.0:1790656581.794827:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656581.794833:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877639269774848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790656581.794837:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269775488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656581.794842:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790656581.794885:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656581.795158:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1877639269774848:12345-0@lo:1000:mdt00_002.0 Request processed in 324us (3940us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790656581.795171:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656581.795215:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1877639269774848:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790656581.795270:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795283:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795292:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795299:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.795305:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795315:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795335:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656581.795338:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656581.795344:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795351:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb0d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795396:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795440:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795457:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795463:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656581.795466:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795472:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656581.795485:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656581.795487:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795493:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eafff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795545:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795563:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795572:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795627:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656581.795655:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 16 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656581.795670:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf80000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269775616:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656581.795757:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e161a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656581.800408:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf80000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269775616:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656581.800449:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.801471:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269775104:0@lo:400:kworker.0 00000100:00100000:3.0:1790656581.801510:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269775232:0@lo:400:kworker.0 00000100:00100000:0.0:1790656581.804576:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656581.804782:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248783744 00000100:00100000:3.0:1790656581.804873:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248783744 00010000:00010000:3.0:1790656581.804929:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656581.804975:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1790656581.804986:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+17:2341:x1877639248783744:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656581.805006:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656581.805014:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805029:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805057:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb01b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377c4 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805074:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:3.0:1790656581.805080:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805091:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805113:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656581.805150:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656581.805213:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+16:2341:x1877639248783744:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 228us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656581.805232:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00010000:00010000:0.0:1790656581.805306:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805315:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805329:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805336:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805343:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805349:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656581.805354:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805371:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805382:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:0.0:1790656581.805385:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656581.805390:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb0d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805431:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805438:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805443:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805448:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656581.805451:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805457:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805465:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:0.0:1790656581.805468:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656581.805471:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.805476:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb0ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656581.805799:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+15:10424:x1877639248783488:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 46146us (46383us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1790656581.805819:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000020:00080000:0.0:1790656581.805824:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790656581.806520:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790656581.806528:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790656581.806559:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790656581.806567:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790656581.812415:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656581.812688:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248784000 00000100:00100000:0.0:1790656581.812703:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248784000 00000100:00100000:0.0:1790656581.812791:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1790656581.812813:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+15:10424:x1877639248784000:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790656581.813700:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790656581.813828:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1790656581.813885:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813907:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813921:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813931:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813939:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813945:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.813968:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790656581.814091:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+17:10424:x1877639248784000:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1287us (1697us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1790656581.814101:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000020:00080000:0.0:1790656581.814107:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790656581.814152:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656581.814160:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.814187:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656581.814192:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.814200:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.814214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94391836d100) 00010000:00010000:0.0:1790656581.814217:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790656581.814223:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.814229:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb0df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656581.814248:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656581.814250:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656581.814251:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790656582.270369:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790656582.270386:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790656582.270463:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790656582.270470:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790656582.369154:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656582.381648:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656582.385688:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248784256 00000100:00100000:0.0:1790656582.385711:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248784256 00000100:00100000:0.0:1790656582.385809:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:0.0:1790656582.385822:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+17:10443:x1877639248784256:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656582.385858:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656582.385885:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb0e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2377fc expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.386018:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eb0ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.386049:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eb0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.386062:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eb0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656582.386076:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790656582.386227:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb0e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377fc expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.386249:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eb0ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377fc expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.386259:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:0.0:1790656582.386262:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790656582.386266:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506800, rc 0) 00000100:00100000:0.0:1790656582.386351:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+19:10443:x1877639248784256:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 532us (4719us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1790656582.386359:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:0.0:1790656582.399638:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.399897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248784384 00000100:00100000:2.0:1790656582.399910:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248784384 00000100:00100000:2.0:1790656582.399980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:2.0:1790656582.399992:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+19:10443:x1877639248784384:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656582.400096:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400118:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400132:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400151:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400159:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400190:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400502:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656582.400568:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400619:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400627:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400635:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400642:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.400647:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400655:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400669:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656582.400678:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.400684:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400691:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb0fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400706:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400712:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400718:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400724:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.400727:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400732:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400740:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a400) 00010000:00010000:2.0:1790656582.400742:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.400745:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400751:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400766:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400777:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400783:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400789:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.400792:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400798:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400805:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a900) 00010000:00010000:2.0:1790656582.400807:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.400810:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.400815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.400923:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+19:10443:x1877639248784384:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 931us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.400933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:3.0:1790656582.460613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.460763:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248784640 00000100:00100000:2.0:1790656582.460776:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248784640 00000100:00100000:2.0:1790656582.460853:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:2.0:1790656582.460865:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+19:10446:x1877639248784640:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656582.460892:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656582.460938:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb110 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237803 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461037:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461056:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461070:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461087:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461094:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461100:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461444:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461454:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461461:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656582.461473:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790656582.461628:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461648:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461655:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461666:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.461671:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461680:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461694:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656582.461697:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.461703:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461710:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461725:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461731:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461737:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461742:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.461752:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461758:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461766:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a900) 00010000:00010000:2.0:1790656582.461769:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.461772:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461777:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461828:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461843:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.461849:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.461851:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656582.461854:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656582.461940:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+21:10446:x1877639248784640:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1077us (1356us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1790656582.461950:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:0.0:1790656582.469243:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.469326:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248784768 00000100:00100000:2.0:1790656582.469341:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248784768 00000100:00100000:2.0:1790656582.469425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:2.0:1790656582.469438:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+21:10446:x1877639248784768:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1790656582.469549:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469573:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469625:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469662:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469670:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469677:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469684:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.469689:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469698:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469711:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.469715:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656582.469722:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.469729:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.469841:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+21:10446:x1877639248784768:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 405us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.469849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:0.0:1790656582.474375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656582.474466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785024 00000100:00100000:1.0:1790656582.474479:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785024 00000100:00100000:1.0:1790656582.474554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1790656582.474567:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+21:10446:x1877639248785024:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1790656582.475186:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+22:10446:x1877639248785024:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 618us (821us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790656582.475195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1790656582.526772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.526981:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785280 00000100:00100000:2.0:1790656582.526995:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785280 00000100:00100000:2.0:1790656582.527070:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:2.0:1790656582.527093:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+22:9975:x1877639248785280:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656582.527124:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656582.527151:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb13a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23780a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.527280:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.527298:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.527323:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.527368:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.527383:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 23 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.527410:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269775744:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656582.527540:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790656582.543195:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656582.543536:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785408 00000100:00100000:1.0:1790656582.543552:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785408 00010000:00010000:1.0:1790656582.543638:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 24 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656582.543687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1790656582.543699:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+24:2342:x1877639248785408:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656582.543869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656582.543879:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 24 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.543894:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 24 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.543923:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:1.0:1790656582.543929:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.543950:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.543960:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.543987:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656582.544066:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+24:2342:x1877639248785408:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 369us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656582.544074:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00010000:00010000:0.0:1790656582.544250:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237803 expref: 23 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656582.544280:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269775744:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656582.544306:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.544438:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.544448:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656582.544476:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790656582.544889:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb13a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.544911:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.544920:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.544924:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790656582.544927:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656582.544983:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+23:9975:x1877639248785280:12345-192.168.203.23@tcp:101:bash.0 Request processed in 17893us (18227us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790656582.544991:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:3.0:1790656582.549737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.549832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785664 00000100:00100000:2.0:1790656582.549845:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785664 00000100:00100000:2.0:1790656582.549917:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1790656582.549931:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+23:9975:x1877639248785664:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:3.0:1790656582.552818:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.552851:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.552865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790656582.552938:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1790656582.552972:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fc7918e reply state 00000000702f50ed transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656582.552985:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790656582.553040:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1790656582.553245:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+27:9975:x1877639248785664:12345-192.168.203.23@tcp:36:bash.0 Request processed in 3312us (3517us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1790656582.553257:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000020:00080000:3.0:1790656582.553282:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790656582.561847:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561875:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561914:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561921:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.561928:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561937:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561960:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.561965:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.561970:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.561978:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb14f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656582.564199:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.564292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785792 00000100:00100000:2.0:1790656582.564305:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785792 00000100:00100000:2.0:1790656582.564382:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:2.0:1790656582.564403:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+26:9975:x1877639248785792:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656582.564436:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656582.564460:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237811 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.564537:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237811 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.564586:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237811 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.564655:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.564660:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656582.564664:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481c00, rc 0) 00000100:00100000:2.0:1790656582.564739:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+27:9975:x1877639248785792:12345-192.168.203.23@tcp:101:bash.0 Request processed in 347us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.564746:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:0.0:1790656582.567304:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656582.567718:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248785920 00000100:00100000:1.0:1790656582.567731:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248785920 00000100:00100000:1.0:1790656582.567803:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1790656582.567815:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+6:9975:x1877639248785920:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656582.567840:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656582.567865:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237818 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656582.567897:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abb4044, atime: 0x6abb4042, ctime: 0x6abb4044, blocks: 0xb 00010000:00010000:1.0:1790656582.567925:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1790656582.567930:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656582.567939:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 7 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.567961:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 7 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.567999:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf800, rc 0) 00000100:00100000:1.0:1790656582.568073:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:9975:x1877639248785920:12345-192.168.203.23@tcp:101:bash.0 Request processed in 260us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656582.568081:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1790656582.572360:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656582.572497:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786048 00000100:00100000:3.0:1790656582.572511:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786048 00002000:00010000:3.0:1790656582.572571:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1790656582.573440:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393f9fd180 with x1877639248786048 ext(0->18446744073709551615) 00002000:00010000:3.0:1790656582.573459:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393f9fd180. 00000100:00100000:3.0:1790656582.573513:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656582.573534:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+7:2339:x1877639248786048:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:3.0:1790656582.574171:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790656582.574176:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790656580 -> 1790656581 00002000:00010000:3.0:1790656582.574179:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790656578 -> 1790656578 00002000:00010000:3.0:1790656582.574182:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790656580 -> 1790656581 00002000:00010000:3.0:1790656582.574184:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790656582.574273:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+8:2339:x1877639248786048:12345-192.168.203.23@tcp:10:bash.0 Request processed in 748us (1927us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790656582.574283:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00010000:3.0:1790656582.574287:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1790656582.574290:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393f9fd180 with x1877639248786048 ext(0->18446744073709551615) 00002000:00010000:3.0:1790656582.574296:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393f9fd180. 00000100:00100000:0.0:1790656582.649295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.649411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786176 00000100:00100000:2.0:1790656582.649423:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786176 00000100:00100000:2.0:1790656582.649501:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:2.0:1790656582.649513:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+27:10460:x1877639248786176:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656582.649845:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.649868:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.649882:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.649900:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.649908:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.649940:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650221:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650230:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650237:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656582.650286:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650299:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650306:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650314:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650321:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.650326:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650334:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650349:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656582.650359:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.650366:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650373:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650388:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650402:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650409:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650415:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.650417:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650423:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650431:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a900) 00010000:00010000:2.0:1790656582.650433:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.650436:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb16b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650456:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650884:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650891:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650896:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.650900:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650906:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650916:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.650919:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.650922:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.650928:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.651032:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+27:10460:x1877639248786176:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1517us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.651043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:0.0:1790656582.688121:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.688236:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786432 00000100:00100000:2.0:1790656582.688250:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786432 00000100:00100000:2.0:1790656582.688322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:2.0:1790656582.688334:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+27:10463:x1877639248786432:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656582.688362:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656582.688416:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23781f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688520:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688538:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688552:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688569:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688588:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.688636:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689074:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb18e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689087:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689095:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656582.689106:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790656582.689223:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689243:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689250:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689257:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.689263:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689271:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689285:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656582.689288:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.689294:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689301:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689316:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689324:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689330:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689336:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.689345:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689352:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689360:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a900) 00010000:00010000:2.0:1790656582.689363:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.689366:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689372:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689443:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23781f expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689460:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23781f expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.689479:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.689482:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790656582.689486:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480600, rc 0) 00000100:00100000:2.0:1790656582.689570:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+29:10463:x1877639248786432:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1238us (1462us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790656582.689645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:1.0:1790656582.693151:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656582.693356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786560 00000100:00100000:3.0:1790656582.693370:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786560 00000100:00100000:3.0:1790656582.693456:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:3.0:1790656582.693467:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+29:10463:x1877639248786560:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1790656582.693560:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.693623:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.693653:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.693804:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.693823:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 29 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656582.693841:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390a39a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269775872:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656582.693961:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38000 going to sleep for 11 seconds 00000100:00100000:3.0:1790656582.696964:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390a39a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269775872:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656582.697011:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656582.698216:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656582.698782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786816 00000100:00100000:3.0:1790656582.698794:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786816 00000100:00100000:3.0:1790656582.698908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1790656582.698920:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+30:5580:x1877639248786816:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790656582.699466:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+31:5580:x1877639248786816:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 546us (1256us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1790656582.699475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1790656582.705851:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656582.705999:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248786944 00000100:00100000:3.0:1790656582.706013:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248786944 00010000:00010000:3.0:1790656582.706070:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 31 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656582.706144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1790656582.706156:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+31:2342:x1877639248786944:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656582.706175:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656582.706183:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 31 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706198:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 31 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706223:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb141 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23780a expref: 31 pid: 6714 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706241:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:3.0:1790656582.706247:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706257:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706265:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.706303:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656582.706367:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+30:2342:x1877639248786944:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 213us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656582.706375:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00010000:00010000:1.0:1790656582.706552:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706562:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706641:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706649:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706657:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706663:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656582.706667:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706675:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706692:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:1.0:1790656582.706695:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656582.706699:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656582.706705:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066eb19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656582.706747:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+29:10463:x1877639248786560:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 13283us (13612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656582.706756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:0.0:1790656582.710201:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.710309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248787200 00000100:00100000:2.0:1790656582.710323:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248787200 00000100:00100000:2.0:1790656582.710390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1790656582.710408:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+29:10463:x1877639248787200:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656582.710751:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+30:10463:x1877639248787200:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 343us (565us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1790656582.710760:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:3.0:1790656582.804186:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.804409:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248787456 00000100:00100000:2.0:1790656582.804423:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248787456 00000100:00100000:3.0:1790656582.805535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:3.0:1790656582.805551:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+30:10474:x1877639248787456:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1790656582.805610:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656582.805640:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb1a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237826 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806145:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806167:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806180:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806198:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806205:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806212:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806693:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806777:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806788:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656582.806815:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790656582.806943:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806953:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806960:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806967:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656582.806971:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806980:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.806994:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656582.806998:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656582.807004:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807011:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807025:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807031:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807050:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807056:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656582.807058:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807065:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807073:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3f00) 00010000:00010000:3.0:1790656582.807076:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656582.807079:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807084:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807147:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb1a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237826 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807163:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237826 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.807170:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:3.0:1790656582.807172:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656582.807174:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656582.807410:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:10474:x1877639248787456:12345-192.168.203.23@tcp:101:cat.0 Request processed in 1862us (3238us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790656582.807429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:1.0:1790656582.813429:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.813646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248787712 00000100:00100000:2.0:1790656582.813661:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248787712 00000100:00100000:2.0:1790656582.813740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1790656582.813752:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+32:10474:x1877639248787712:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1790656582.814111:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+33:10474:x1877639248787712:12345-192.168.203.23@tcp:35:cat.0 Request processed in 360us (695us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790656582.814118:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1790656582.835922:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.836317:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248787968 00000100:00100000:2.0:1790656582.836332:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248787968 00000100:00100000:2.0:1790656582.836423:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:2.0:1790656582.836436:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+33:10475:x1877639248787968:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:2.0:1790656582.836527:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790656582.836561:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237826 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836635:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb18e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23781f expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836650:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237811 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836684:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4a400) 00010000:00010000:2.0:1790656582.836696:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656582.836722:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836738:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836749:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836765:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836772:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.836778:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837089:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837098:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837105:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656582.837767:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1790656582.837779:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297974186861ns, next at 298974183976ns, rc = 0 00010000:00010000:2.0:1790656582.837857:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837868:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837876:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837883:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837890:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837897:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837913:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790656582.837937:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837944:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837951:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837958:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.837962:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837971:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.837989:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ad00) 00010000:00010000:2.0:1790656582.837992:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790656582.837997:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838004:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb1d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838019:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838026:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838032:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838037:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656582.838040:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838045:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656582.838054:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656582.838056:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.838063:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb1c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656582.838082:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df2f155c reply state 00000000b82cb124 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.838091:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656582.838194:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+32:10475:x1877639248787968:12345-192.168.203.23@tcp:36:rm.0 Request processed in 1759us (2294us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790656582.838203:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00010000:00010000:0.0:1790656582.839163:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656582.839178:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.839187:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656582.839192:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.839200:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.839216:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943909b4ad00) 00010000:00010000:0.0:1790656582.839218:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790656582.839223:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.839229:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb1db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.839252:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656582.839268:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656582.839270:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656582.840807:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840826:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840834:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840840:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656582.840846:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840853:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840871:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a900) 00010000:00010000:3.0:1790656582.840875:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656582.840879:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.840885:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb1cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656582.876789:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656582.877286:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788224 00000100:00100000:0.0:1790656582.877301:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788224 00000100:00100000:0.0:1790656582.877413:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:0.0:1790656582.877425:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+31:10481:x1877639248788224:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656582.877454:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656582.877479:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb1e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23782d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877650:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877666:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877681:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877705:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877712:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.877719:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790656582.878386:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1790656582.878629:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878656:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878665:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878708:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878715:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878722:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878728:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656582.878733:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878741:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878755:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:0.0:1790656582.878758:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656582.878763:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878770:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb1e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656582.878788:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027c098e5 reply state 00000000046179a4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656582.878805:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790656582.878847:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb1e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 34 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878863:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 33 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.878869:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:0.0:1790656582.878871:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656582.878874:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506200, rc 0) 00000100:00100000:0.0:1790656582.878993:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:10481:x1877639248788224:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1569us (2216us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790656582.879002:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:1.0:1790656582.884929:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1790656582.885435:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885452:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885485:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885492:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656582.885498:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885508:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885529:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94391836d100) 00010000:00010000:3.0:1790656582.885533:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656582.885539:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656582.885546:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb1f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.885846:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788352 00000100:00100000:2.0:1790656582.885860:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788352 00000100:00100000:2.0:1790656582.885947:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1790656582.885960:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248788352:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656582.885983:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656582.886007:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237834 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790656582.886039:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790656582.886065:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=298s v=(0 0) 00010000:00010000:2.0:1790656582.886070:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656582.886082:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.886102:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.886116:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656582.886183:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248788352:12345-192.168.203.23@tcp:101:bash.0 Request processed in 226us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.886200:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00080000:0.0:1790656582.886442:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656582.889221:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656582.889453:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788480 00000100:00100000:0.0:1790656582.889466:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788480 00000100:00100000:0.0:1790656582.889643:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1790656582.889657:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+8:10481:x1877639248788480:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656582.889680:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656582.889715:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23783b expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.889758:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.889769:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656582.889791:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656582.889798:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 9 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.889843:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.889860:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656582.889877:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fa81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8825:1877639269776000:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656582.889992:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1790656582.892876:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fa81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8825:1877639269776000:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656582.892938:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 9 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656582.892965:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507000, rc 0) 00000100:00100000:0.0:1790656582.893041:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+9:10481:x1877639248788480:12345-192.168.203.23@tcp:101:bash.0 Request processed in 3386us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656582.893051:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:1.0:1790656582.895792:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.896003:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788608 00000100:00100000:2.0:1790656582.896016:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788608 00010000:00010000:2.0:1790656582.896071:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.896122:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1790656582.896133:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928789450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248788608:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656582.896152:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656582.896180:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.896196:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.896225:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb205 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237834 expref: 9 pid: 6690 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.896249:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656582.896254:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656582.896263:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.896275:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656582.896348:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656582.896365:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877639269776128:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656582.896477:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656582.899137:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877639269776128:192.168.203.23@tcp:105: 00010000:00010000:2.0:1790656582.899173:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656582.899245:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928789450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248788608:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3112us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656582.899259:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1790656582.902103:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656582.902216:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788864 00000100:00100000:2.0:1790656582.902229:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788864 00000100:00100000:2.0:1790656582.902297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1790656582.902309:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+33:10481:x1877639248788864:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1790656582.903010:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+34:10481:x1877639248788864:12345-192.168.203.23@tcp:35:bash.0 Request processed in 699us (919us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790656582.903021:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1790656583.038704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.038837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248788992 00000100:00100000:2.0:1790656583.038850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248788992 00000100:00100000:2.0:1790656583.038933:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:2.0:1790656583.038947:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+34:10497:x1877639248788992:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656583.038983:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656583.039012:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237842 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039131:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039149:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039163:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656583.039206:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790656583.039212:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656583.039235:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039264:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237842 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039292:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237842 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.039301:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656583.039305:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656583.039309:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656583.039402:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+35:10497:x1877639248788992:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 450us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.039410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00080000:0.0:1790656583.039462:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656583.045137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.045261:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248789248 00000100:00100000:3.0:1790656583.045274:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248789248 00000100:00100000:3.0:1790656583.045356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:3.0:1790656583.045371:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+35:10497:x1877639248789248:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656583.045408:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656583.045434:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237849 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.045565:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.045636:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.045649:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656583.045664:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790656583.045845:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237849 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.045865:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237849 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.045874:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:3.0:1790656583.045877:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656583.045882:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656583.046456:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+37:10497:x1877639248789248:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1086us (1520us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1790656583.046466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:1.0:1790656583.052455:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.052516:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.052784:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248789376 00000100:00100000:0.0:1790656583.052797:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248789376 00000100:00100000:0.0:1790656583.052880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1790656583.052893:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+37:2342:x1877639248789376:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656583.052912:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656583.053123:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237849 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.053149:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:0.0:1790656583.053155:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656583.053232:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+36:2342:x1877639248789376:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 343us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.053242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1790656583.053620:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248789632 00000100:00100000:3.0:1790656583.053628:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248789632 00000100:00100000:3.0:1790656583.053676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:3.0:1790656583.053685:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+36:10497:x1877639248789632:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656583.053711:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656583.053731:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237850 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.053871:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.053887:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.053899:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656583.053913:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790656583.055032:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237850 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.055061:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237850 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.055071:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:3.0:1790656583.055075:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790656583.055079:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656583.055215:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+38:10497:x1877639248789632:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1529us (2696us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790656583.055224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:1.0:1790656583.061742:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.061975:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248789760 00000100:00100000:2.0:1790656583.061990:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248789760 00000100:00100000:2.0:1790656583.062218:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1790656583.062231:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248789760:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:2.0:1790656583.062293:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.062319:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.062330:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656583.062334:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656583.062339:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.062571:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.062629:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 8 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.062658:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1877639269776256:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656583.063202:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790656583.067467:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1877639269776256:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656583.067506:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.068096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.068757:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248789888 00000100:00100000:0.0:1790656583.068769:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248789888 00002000:00100000:0.0:1790656583.068933:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94393fab1500 x1877639248789888/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:444/0 lens 504/0 e 0 to 0 dl 1790656594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656583.068944:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fab1500 with x1877639248789888 ext(0->8) 00010000:00010000:0.0:1790656583.068954:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 9 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.068972:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 9 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656583.068981:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94393fab1500 00000100:00100000:0.0:1790656583.069078:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1790656583.069090:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248789888:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:0.0:1790656583.069926:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+11:2342:x1877639248789888:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 833us (1829us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790656583.069936:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00100000:0.0:1790656583.069946:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94393fab1500 x1877639248789888/t4294967302(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:444/0 lens 504/448 e 0 to 0 dl 1790656594 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656583.069964:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fab1500 with x1877639248789888 ext(0->8) 00010000:00010000:0.0:1790656583.069973:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.069989:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656583.069996:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94393fab1500 00000100:00100000:1.0:1790656583.073944:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.074062:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790016 00000100:00100000:2.0:1790656583.074094:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790016 00010000:00010000:2.0:1790656583.074147:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.074200:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1790656583.074212:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+11:2342:x1877639248790016:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656583.074231:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790656583.074254:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790656583.074257:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790656582 00002000:00010000:2.0:1790656583.074259:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790656582 00002000:00010000:2.0:1790656583.074262:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790656582 00010000:00010000:2.0:1790656583.074269:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.074285:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.074315:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066eb20c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23783b expref: 11 pid: 8825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.074337:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656583.074341:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656583.074347:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.074358:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.074535:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656583.074660:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+10:2342:x1877639248790016:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 448us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.074669:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00010000:00010000:3.0:1790656583.075944:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.075964:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076029:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076038:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076048:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076057:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656583.076062:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076072:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076093:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.076102:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb24b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.076268:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248789760:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 14037us (14538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656583.076279:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1790656583.078462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.078533:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790272 00000100:00100000:2.0:1790656583.078545:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790272 00000100:00100000:2.0:1790656583.078645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1790656583.078657:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+38:10497:x1877639248790272:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:2.0:1790656583.078747:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237850 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656583.079071:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1790656583.079115:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790656583.079533:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1790656583.079627:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.079648:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 42 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.079659:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.079702:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 42 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.079721:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 42 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.079757:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877639269776384:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656583.079868:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c600 going to sleep for 11 seconds 00000100:00100000:3.0:1790656583.085274:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.085299:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1877639269776384:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656583.085337:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.085364:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790400 00000100:00100000:1.0:1790656583.085404:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790400 00010000:00010000:1.0:1790656583.085450:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 43 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.085500:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1790656583.085512:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+43:2341:x1877639248790400:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656583.085530:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656583.085538:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 43 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085552:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 43 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085612:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb1f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23782d expref: 43 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085640:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:1.0:1790656583.085646:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085656:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085664:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.085702:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656583.086289:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+42:2341:x1877639248790400:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 773us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.086315:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00010000:00010000:2.0:1790656583.086518:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.086528:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656583.086741:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1790656583.087259:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1790656583.087403:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269776512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790656583.087477:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656583.087527:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c540 going to sleep for 11 seconds 00000100:00100000:1.0:1790656583.088315:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269776512 00000100:00100000:1.0:1790656583.088329:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269776512 00000100:00100000:1.0:1790656583.088430:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790656583.088441:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1877639269776512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1790656583.088936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656583.089017:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1877639269776512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 576us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.089026:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656583.094371:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf82300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269776512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790656583.095950:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1790656583.096071:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390a398000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269776640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790656583.096159:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656583.096249:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e37780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656583.096354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269776640 00000100:00100000:2.0:1790656583.096362:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269776640 00000100:00100000:2.0:1790656583.096473:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656583.096485:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5847:x1877639269776640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790656583.096808:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5847:x1877639269776640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 325us (647us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790656583.096817:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790656583.096953:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390a398000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1877639269776640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790656583.097027:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1790656583.097075:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097086:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097095:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097102:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656583.097108:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097116:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097135:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:3.0:1790656583.097139:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790656583.097144:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.097151:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb252 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656583.097388:0:5847:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790656583.097522:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1790656583.097537:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298233944616ns, next at 299233942409ns, rc = 0 00000001:00080000:3.0:1790656583.097544:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1790656583.097579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836de00) 00010000:00010000:3.0:1790656583.097582:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790656583.097627:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb23d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237850 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.097768:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+45:10497:x1877639248790272:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 19112us (19314us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1790656583.097776:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000020:00080000:3.0:1790656583.097781:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790656583.104883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.107779:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790528 00000100:00100000:0.0:1790656583.107802:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790528 00000100:00100000:0.0:1790656583.107891:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:0.0:1790656583.107904:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+45:10497:x1877639248790528:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656583.107936:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.107967:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237857 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.108049:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237857 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.108067:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237857 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.108091:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656583.108504:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790656583.108511:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506e00, rc 0) 00000100:00100000:0.0:1790656583.108651:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+46:10497:x1877639248790528:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 748us (3781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.108659:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:0.0:1790656583.113728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.113896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790784 00000100:00100000:2.0:1790656583.113927:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790784 00000100:00100000:2.0:1790656583.113999:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1790656583.114012:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+46:10497:x1877639248790784:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656583.114336:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+47:10497:x1877639248790784:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 325us (620us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1790656583.114344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1790656583.203580:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.203708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248790912 00000100:00100000:2.0:1790656583.203721:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248790912 00000100:00100000:2.0:1790656583.203805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:2.0:1790656583.203817:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+47:10507:x1877639248790912:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656583.203919:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.203941:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.203956:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.203972:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.203978:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.203984:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204107:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204137:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204146:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656583.204201:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204216:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204224:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204231:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204238:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.204243:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204252:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204265:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656583.204268:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.204274:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204280:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204304:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204310:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204316:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204322:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.204325:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204332:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204339:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943909b4a400) 00010000:00010000:2.0:1790656583.204342:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.204345:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204351:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204370:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204376:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204381:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204402:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.204406:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204412:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204421:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.204423:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.204426:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.204432:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb26e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.204533:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+47:10507:x1877639248790912:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 716us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.204542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:1.0:1790656583.268986:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.269216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248791168 00000100:00100000:3.0:1790656583.269236:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248791168 00000100:00100000:3.0:1790656583.269331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:3.0:1790656583.269346:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+47:10510:x1877639248791168:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656583.269373:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656583.269416:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23785e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269579:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269667:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269685:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269693:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.269700:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270320:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270333:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270342:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656583.270355:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790656583.270564:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270573:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270580:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.270586:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656583.271161:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271173:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271192:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656583.271196:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656583.271202:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271209:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb27c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271229:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271236:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271243:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271249:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656583.271252:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271257:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271265:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9439086c3f00) 00010000:00010000:3.0:1790656583.271267:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656583.271278:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271285:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271355:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271371:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.271379:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656583.271381:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656583.271384:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656583.273362:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+49:10510:x1877639248791168:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 3992us (4362us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790656583.273378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:0.0:1790656583.282809:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.283025:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248791296 00000100:00100000:2.0:1790656583.283038:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248791296 00000100:00100000:2.0:1790656583.283171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:2.0:1790656583.283193:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+49:10510:x1877639248791296:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1790656583.283284:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283305:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283379:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283386:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283405:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283412:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.283417:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283426:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283440:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.283444:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656583.283450:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.283457:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.283566:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+49:10510:x1877639248791296:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 383us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.283574:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:1.0:1790656583.286357:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.286633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248791552 00000100:00100000:3.0:1790656583.286646:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248791552 00000100:00100000:3.0:1790656583.286719:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:3.0:1790656583.286732:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+49:10510:x1877639248791552:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656583.287022:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+50:10510:x1877639248791552:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 291us (679us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790656583.287030:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1790656583.327165:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656583.327206:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390a39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269776768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656583.327457:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656583.328865:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269776768 00000100:00100000:1.0:1790656583.328883:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269776768 00000100:00100000:1.0:1790656583.328970:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790656583.328985:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269776768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656583.329035:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656583.329203:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269776768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.329210:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1790656583.331467:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656583.340974:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390a39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269776768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656583.369140:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.369358:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248791808 00000100:00100000:0.0:1790656583.369373:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248791808 00000100:00100000:0.0:1790656583.369462:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:0.0:1790656583.369475:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+50:10520:x1877639248791808:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656583.369512:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.369516:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790656583.369551:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb21a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237842 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369588:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:0.0:1790656583.369649:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656583.369667:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb29f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237865 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369810:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369828:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369862:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369906:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.369923:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 50 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656583.369941:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269776896:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656583.370066:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656583.373400:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269776896:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656583.373442:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.378911:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.379052:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248791936 00000100:00100000:1.0:1790656583.379066:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248791936 00010000:00010000:1.0:1790656583.379162:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 51 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.379213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1790656583.379225:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+51:2340:x1877639248791936:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656583.379270:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656583.379279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 51 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379293:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 51 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379322:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb28a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23785e expref: 51 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379341:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656583.379346:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379357:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379365:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.379407:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656583.379551:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.379560:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656583.379585:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790656583.379810:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb29f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.379830:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.379839:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.379842:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790656583.379845:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507600, rc 0) 00000100:00100000:1.0:1790656583.380004:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+51:2340:x1877639248791936:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 779us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.380013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1790656583.385092:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+50:10520:x1877639248791808:12345-192.168.203.23@tcp:101:bash.0 Request processed in 15599us (15952us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790656583.385110:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:1.0:1790656583.394587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.394745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792192 00000100:00100000:3.0:1790656583.394761:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792192 00000100:00100000:3.0:1790656583.394853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1790656583.394867:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+50:10520:x1877639248792192:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:3.0:1790656583.395312:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.395335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.395350:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790656583.395426:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1790656583.395455:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031b06533 reply state 00000000481b26b4 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.395465:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656583.396560:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+53:10520:x1877639248792192:12345-192.168.203.23@tcp:36:bash.0 Request processed in 1691us (1983us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790656583.396572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000020:00080000:3.0:1790656583.396580:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790656583.397843:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656583.402261:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.402265:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1790656583.402280:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.402289:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.402316:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.402323:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.402331:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.402353:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.402356:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.402362:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.402369:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb2b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656583.402448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792320 00000100:00100000:0.0:1790656583.402462:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792320 00000100:00100000:0.0:1790656583.402538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:0.0:1790656583.402550:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+52:10520:x1877639248792320:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656583.402582:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.402649:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb2bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23786c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.403037:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.403055:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.403065:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.403117:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.403134:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 53 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656583.403160:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269777024:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656583.403851:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656583.410272:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935111f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269777024:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656583.410317:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.415090:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.415402:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792448 00000100:00100000:1.0:1790656583.415416:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792448 00010000:00010000:1.0:1790656583.415485:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 54 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.415577:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1790656583.415908:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+54:2341:x1877639248792448:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656583.415929:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656583.415941:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 54 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.415956:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 54 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.415986:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb2a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237865 expref: 54 pid: 6714 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.416005:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656583.416011:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.416021:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.416030:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.416060:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656583.416092:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.416103:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656583.416165:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790656583.416171:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656583.416198:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.416238:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb2bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.416257:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.416280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656583.416283:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656583.416286:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506400, rc 0) 00000100:00100000:0.0:1790656583.416364:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+53:10520:x1877639248792320:12345-192.168.203.23@tcp:101:bash.0 Request processed in 13815us (14110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.416372:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:2.0:1790656583.416480:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+52:2341:x1877639248792448:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 892us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.416490:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:2.0:1790656583.421431:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.421484:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.421524:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.421634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792576 00000100:00100000:3.0:1790656583.421648:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792576 00000100:00100000:3.0:1790656583.421726:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:3.0:1790656583.421740:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248792576:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656583.421841:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248792576:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656583.421851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:0.0:1790656583.422419:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792832 00000100:00100000:0.0:1790656583.422427:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792832 00000100:00080000:0.0:1790656583.422458:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656583.422504:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:0.0:1790656583.422514:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248792832:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656583.422559:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248792832:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 46us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.422567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:1.0:1790656583.424883:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248792704 00000100:00100000:1.0:1790656583.424901:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248792704 00000100:00100000:1.0:1790656583.425023:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1790656583.425037:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248792704:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656583.425159:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248792704:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 125us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.425168:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00080000:0.0:1790656583.425248:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656583.425354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.425477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793088 00000100:00100000:3.0:1790656583.425483:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793088 00000100:00100000:3.0:1790656583.425524:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1790656583.425533:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+52:10520:x1877639248793088:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1790656583.425827:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+53:10520:x1877639248793088:12345-192.168.203.23@tcp:35:bash.0 Request processed in 295us (474us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1790656583.425835:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1790656583.493273:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.493479:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793216 00000100:00100000:1.0:1790656583.493493:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793216 00000100:00100000:1.0:1790656583.493575:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:1.0:1790656583.493588:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+53:10526:x1877639248793216:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656583.493651:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656583.493681:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb2c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237873 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.493782:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.493801:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.493816:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656583.493861:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790656583.493866:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656583.493889:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.493935:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb2c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237873 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.494499:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237873 expref: 54 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.494529:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:1.0:1790656583.494533:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656583.494537:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cea00, rc 0) 00000100:00100000:1.0:1790656583.494765:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248793216:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1107us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.494775:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:2.0:1790656583.498164:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.498512:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793344 00000100:00100000:0.0:1790656583.498526:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793344 00000100:00100000:0.0:1790656583.498652:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:0.0:1790656583.498666:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248793344:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656583.498708:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.498737:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb2d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23787a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.498825:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.498867:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.498882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.499578:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.499632:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.499643:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500360:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500378:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500399:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656583.500454:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790656583.500461:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656583.500489:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500505:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500538:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500546:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500555:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500562:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656583.500568:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500578:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500629:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:0.0:1790656583.500633:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656583.500639:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500646:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb2de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500664:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500671:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500678:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500705:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656583.500709:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500716:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500725:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94391836db00) 00010000:00010000:0.0:1790656583.500728:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656583.500732:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500739:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500789:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb2d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23787a expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500807:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23787a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.500817:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656583.500819:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656583.500822:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507400, rc 0) 00000100:00100000:0.0:1790656583.502763:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+55:10526:x1877639248793344:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4084us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.502779:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:0.0:1790656583.507436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.507920:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793472 00000100:00100000:1.0:1790656583.507934:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793472 00000100:00100000:1.0:1790656583.508033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1790656583.508048:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+55:2340:x1877639248793472:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656583.508068:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656583.508102:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb2ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23787a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.508129:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656583.508137:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656583.508214:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+54:2340:x1877639248793472:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 170us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.508222:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1790656583.511467:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.512224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793728 00000100:00100000:0.0:1790656583.512310:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793728 00000100:00100000:0.0:1790656583.512449:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:0.0:1790656583.512462:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248793728:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656583.512492:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.512520:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb2f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237881 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.512707:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.512729:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.512739:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.512787:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.512803:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 55 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656583.512818:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269777152:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656583.513356:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656583.518311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.518419:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248793856 00000100:00100000:3.0:1790656583.518433:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248793856 00010000:00010000:3.0:1790656583.518490:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 56 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656583.518539:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1790656583.518549:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+56:2342:x1877639248793856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656583.518575:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656583.518584:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 56 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.518626:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 56 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.518657:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656583.518664:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.518707:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.518718:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.518751:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656583.518832:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+56:2342:x1877639248793856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 282us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656583.518840:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00010000:00010000:0.0:1790656583.521815:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb2c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23786c expref: 55 pid: 5844 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656583.522034:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269777152:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656583.522096:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.522110:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.522116:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656583.522149:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790656583.522475:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb2f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.522497:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.522509:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656583.522513:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790656583.522518:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507e00, rc 0) 00000100:00100000:0.0:1790656583.523233:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+55:10526:x1877639248793728:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 10757us (11764us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1790656583.523248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:2.0:1790656583.528885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.529124:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794112 00000100:00100000:0.0:1790656583.529138:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794112 00000100:00100000:0.0:1790656583.529237:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1790656583.529251:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+55:10526:x1877639248794112:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:0.0:1790656583.529270:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656583.529303:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237857 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.529344:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656583.529351:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656583.529431:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248794112:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 183us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.529440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1790656583.533413:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.533644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794240 00000100:00100000:2.0:1790656583.533658:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794240 00000100:00100000:0.0:1790656583.534047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:0.0:1790656583.534062:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248794240:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:0.0:1790656583.534234:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.534259:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.534274:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656583.534559:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1790656583.534745:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248794240:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 685us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.534757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1790656583.539500:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.539648:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794368 00000100:00100000:1.0:1790656583.539662:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794368 00000100:00100000:1.0:1790656583.539744:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:1.0:1790656583.539756:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:10526:x1877639248794368:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656583.539784:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656583.539810:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237888 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541107:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541154:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541180:0:6714:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541197:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541216:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.541220:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656583.541294:0:6714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.541304:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf600, rc 0) 00000100:00100000:2.0:1790656583.541436:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+55:10526:x1877639248794368:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1682us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.541446:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00000040:00080000:0.0:1790656583.840886:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656583.840899:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656583.849940:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790656583.849959:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790656583.851098:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269777280:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790656583.851245:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656583.859853:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.861065:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269777280:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790656583.865333:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794496 00000100:00100000:3.0:1790656583.865351:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794496 00000100:00100000:3.0:1790656583.865511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:3.0:1790656583.865524:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+55:10527:x1877639248794496:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790656583.865562:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790656583.865741:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+55:10527:x1877639248794496:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 219us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656583.865749:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1790656583.872938:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.873205:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794624 00000100:00100000:0.0:1790656583.873220:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794624 00000100:00100000:0.0:1790656583.873291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1790656583.873304:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+55:10527:x1877639248794624:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790656583.873410:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.873431:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.873446:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.876912:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.876941:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.876957:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877000:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877010:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877016:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656583.877074:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790656583.877080:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656583.877096:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877110:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877117:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877125:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877150:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656583.877155:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877164:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877181:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:1.0:1790656583.877184:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656583.877189:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877196:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb316 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877215:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877221:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877228:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877233:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656583.877236:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877243:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877264:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9439148d8000) 00010000:00010000:1.0:1790656583.877267:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656583.877270:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877277:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb31d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877296:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877302:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877308:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877314:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656583.877317:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877323:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877331:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656583.877333:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656583.877336:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.877342:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656583.877538:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+55:10527:x1877639248794624:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 4229us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.877549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:1.0:1790656583.887646:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.887749:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248794880 00000100:00100000:2.0:1790656583.887763:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248794880 00000100:00100000:2.0:1790656583.887841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:2.0:1790656583.887853:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+55:10527:x1877639248794880:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790656583.887879:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656583.887905:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb32b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23788f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888059:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888091:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656583.888103:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790656583.888229:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888238:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888246:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888253:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.888269:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888277:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888292:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656583.888296:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790656583.888302:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888320:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888372:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb32b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23788f expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:2.0:1790656583.888400:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656583.888404:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb32b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23788f expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.888414:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481e00, rc 0) 00000100:00100000:2.0:1790656583.893634:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248794880:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 5766us (5986us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1790656583.893651:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1790656583.904041:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.904220:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248795008 00000100:00100000:2.0:1790656583.904234:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248795008 00000100:00100000:2.0:1790656583.904307:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1790656583.904320:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248795008:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790656583.904369:0:6714:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790656583.904504:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248795008:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 186us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.904512:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:1.0:1790656583.914713:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.915316:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248795264 00000100:00100000:3.0:1790656583.915333:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248795264 00000100:00100000:3.0:1790656583.915431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1790656583.915444:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248795264:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656583.915471:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656583.915475:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790656583.915508:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb2d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237873 expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.915561:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:3.0:1790656583.915568:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656583.915655:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb340 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237896 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656583.917100:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790656583.921344:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.921376:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.921399:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.921486:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb340 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237896 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.921510:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237896 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.921520:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9439086c3f00) 00010000:00010000:3.0:1790656583.921523:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656583.921528:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656583.921641:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:10527:x1877639248795264:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 6198us (6933us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790656583.921652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1790656583.928669:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.940812:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248795520 00000100:00100000:2.0:1790656583.940835:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248795520 00000100:00100000:2.0:1790656583.940979:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:2.0:1790656583.941010:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+57:10527:x1877639248795520:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790656583.941086:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656583.941119:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237896 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.941145:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9439086c3f00) 00010000:00010000:2.0:1790656583.941157:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656583.941193:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.941211:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.941222:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947062:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947091:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947105:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947180:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947188:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947214:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947221:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.947225:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947232:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947244:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656583.947248:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.947252:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947258:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb355 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947271:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947276:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947281:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947286:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656583.947289:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947306:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947314:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xda74ffcb (ffff943909b4a400) 00010000:00010000:2.0:1790656583.947317:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656583.947320:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656583.947324:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb35c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda74ffcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.947440:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248795520:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 6428us (18782us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790656583.947450:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:1.0:1790656583.951531:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.951971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248795648 00000100:00100000:2.0:1790656583.951981:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248795648 00000100:00100000:0.0:1790656583.952105:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:0.0:1790656583.952117:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:10527:x1877639248795648:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656583.952138:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656583.952171:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb363 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23789d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952214:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952237:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb363 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952371:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.952379:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:0.0:1790656583.952382:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656583.952394:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506000, rc 0) 00000100:00100000:0.0:1790656583.952461:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+57:10527:x1877639248795648:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 346us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.952474:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:1.0:1790656583.959857:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656583.960408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248795904 00000100:00100000:3.0:1790656583.960428:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248795904 00000100:00100000:3.0:1790656583.960528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:3.0:1790656583.960543:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:10527:x1877639248795904:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790656583.960742:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.960764:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.960782:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656583.961224:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1790656583.961237:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299097644782ns, next at 300097642406ns, rc = 0 00000004:00010000:2.0:1790656583.961339:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1adf1ba reply state 00000000ee724aec transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656583.961349:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656583.961468:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+59:10527:x1877639248795904:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 927us (1617us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790656583.961477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:1.0:1790656583.965058:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.965193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796032 00000100:00100000:0.0:1790656583.965212:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796032 00000100:00100000:0.0:1790656583.965268:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:0.0:1790656583.965280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+59:10527:x1877639248796032:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656583.965304:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656583.965334:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.965335:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965372:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965418:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.965429:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965855:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656583.965864:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965875:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965896:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:3.0:1790656583.965900:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790656583.965928:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656583.965935:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.966863:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656583.966913:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:0.0:1790656583.966917:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790656583.966921:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506c00, rc 0) 00000100:00100000:0.0:1790656583.966981:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+59:10527:x1877639248796032:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1704us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656583.966989:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1790656583.974251:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.974503:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796160 00000100:00100000:0.0:1790656583.974513:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796160 00000100:00100000:0.0:1790656583.974581:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1790656583.974620:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248796160:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790656583.974921:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248796160:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 330us (678us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790656583.974928:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1790656583.977089:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656583.977185:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796416 00000100:00100000:0.0:1790656583.977193:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796416 00000100:00100000:0.0:1790656583.977652:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1790656583.977662:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+59:10527:x1877639248796416:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790656583.978127:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+60:10527:x1877639248796416:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 466us (1044us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790656583.978135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1790656583.985685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656583.985778:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796672 00000100:00100000:2.0:1790656583.985788:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796672 00000100:00100000:2.0:1790656583.985848:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:2.0:1790656583.985859:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+60:10527:x1877639248796672:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790656583.985992:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+60:10527:x1877639248796672:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656583.986000:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:3.0:1790656583.995106:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656583.995666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796800 00000100:00100000:1.0:1790656583.995675:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796800 00000100:00100000:1.0:1790656583.995734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:1.0:1790656583.995744:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+60:10527:x1877639248796800:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656583.995763:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656583.995782:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb37f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378ab expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995847:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995861:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995872:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656583.995918:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656583.995937:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995963:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb37f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ab expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995981:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ab expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656583.995991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:1.0:1790656583.995994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790656583.995998:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce000, rc 0) 00000100:00100000:1.0:1790656583.996061:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+61:10527:x1877639248796800:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 319us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656583.996068:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:3.0:1790656584.001852:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.001961:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248796928 00000100:00100000:0.0:1790656584.001970:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248796928 00000100:00100000:0.0:1790656584.002016:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1790656584.002026:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248796928:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656584.002057:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656584.002077:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378b2 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656584.002101:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abb4047, blocks: 0x1 00010000:00010000:0.0:1790656584.002120:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1790656584.002125:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656584.002134:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 10 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.002164:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 10 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.002178:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507200, rc 0) 00000100:00100000:0.0:1790656584.002242:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+10:2342:x1877639248796928:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 216us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.002249:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1790656584.006275:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656584.006465:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797184 00000100:00100000:2.0:1790656584.006473:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797184 00000100:00100000:2.0:1790656584.006526:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:2.0:1790656584.006536:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:10527:x1877639248797184:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790656584.006671:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:10527:x1877639248797184:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 136us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656584.006679:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:3.0:1790656584.016725:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.016805:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797312 00000100:00100000:0.0:1790656584.016814:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797312 00000100:00100000:0.0:1790656584.016867:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1790656584.016877:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+10:10527:x1877639248797312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656584.016894:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656584.016913:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378b9 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.016942:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.016966:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656584.016970:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656584.016977:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.017009:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.017024:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.017038:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269777408:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656584.017132:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1790656584.021120:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269777408:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656584.021164:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.021185:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506600, rc 0) 00000100:00100000:0.0:1790656584.021240:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+11:10527:x1877639248797312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4363us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.021249:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1790656584.023295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656584.023497:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797440 00000100:00100000:2.0:1790656584.023505:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797440 00010000:00010000:2.0:1790656584.023544:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.023588:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1790656584.023626:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+11:2342:x1877639248797440:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656584.023641:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656584.023660:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.023674:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.023697:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646cfe9c/0x9c3a6e82066eb38d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b2 expref: 11 pid: 8825 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.023729:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656584.023734:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656584.023742:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.023753:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.023801:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.023816:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392842ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269777536:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656584.023887:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c540 going to sleep for 11 seconds 00000100:00100000:3.0:1790656584.027788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656584.027868:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797568 00000100:00100000:1.0:1790656584.027877:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797568 00002000:00100000:1.0:1790656584.027931:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94390a399c00 x1877639248797568/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:445/0 lens 504/0 e 0 to 0 dl 1790656595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656584.027942:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94390a399c00 with x1877639248797568 ext(0->12) 00002000:00010000:1.0:1790656584.027948:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94390a399c00 00000100:00100000:1.0:1790656584.027979:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:1.0:1790656584.027989:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+11:2342:x1877639248797568:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790656584.028617:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+13:2342:x1877639248797568:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 599us (808us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790656584.028633:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:1.0:1790656584.028642:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94390a399c00 x1877639248797568/t4294967308(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:445/0 lens 504/448 e 0 to 0 dl 1790656595 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656584.028650:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94390a399c00 with x1877639248797568 ext(0->12) 00002000:00010000:1.0:1790656584.028654:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94390a399c00 00000100:00100000:2.0:1790656584.028760:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392842ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269777536:192.168.203.23@tcp:105: 00010000:00010000:2.0:1790656584.028781:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656584.028802:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+12:2342:x1877639248797440:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 5178us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656584.028810:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1790656584.030910:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656584.031097:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797696 00000100:00100000:1.0:1790656584.031106:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797696 00000100:00100000:1.0:1790656584.031160:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1790656584.031171:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+61:10527:x1877639248797696:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790656584.093700:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1790656584.093737:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790656584.093763:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1790656584.093793:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790656584.093806:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943908e38a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790656584.093810:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943908d9c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943908e38540 00000020:00080000:2.0:1790656584.093826:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943908d9ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943907dd3800 00000020:00080000:2.0:1790656584.093845:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943908e38780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790656584.093847:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943908d9c600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943908e38b40 00000020:00080000:2.0:1790656584.093850:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943908d9cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943907dd1000 00000020:00080000:2.0:1790656584.093862:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1790656584.094182:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1790656584.094320:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656584.094340:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390a398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269777664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790656584.094413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1790656584.094677:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790656584.094796:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390a39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269777792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790656584.094826:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656584.094850:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656584.094856:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269777920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790656584.094878:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656584.094914:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269777664 00000100:00100000:3.0:1790656584.094920:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269777664 00000100:00100000:3.0:1790656584.094955:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269777792 00000100:00100000:3.0:1790656584.094958:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269777792 00000100:00100000:3.0:1790656584.094969:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269777920 00000100:00100000:3.0:1790656584.094972:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269777920 00000100:00100000:3.0:1790656584.094985:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790656584.094992:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1877639269777664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790656584.095017:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1790656584.095043:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.095074:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 11 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.095083:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790656584.095087:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656584.095092:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.095117:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 11 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.095129:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 11 pid: 8825 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656584.095141:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269778048:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656584.095282:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656584.095291:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943909793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269777792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790656584.095419:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790656584.095422:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790656583 00002000:00010000:1.0:1790656584.095425:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790656584.095427:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790656583 -> 1790656583 00002000:00010000:1.0:1790656584.095429:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790656584.095468:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943909793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1877639269777792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (640us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790656584.095475:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656584.095492:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656584.095498:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1877639269777920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790656584.095519:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1790656584.095540:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abb4046, atime: 0x6abb4046, ctime: 0x6abb4046, blocks: 0x1 00010000:00010000:1.0:1790656584.095545:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.095555:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1790656584.095558:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656584.095576:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.095611:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.095622:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.095631:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.095648:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790656584.095861:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439148f3b40 going to sleep for 11 seconds 00000004:00080000:3.0:1790656584.096643:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94390a39bb80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1790656584.096651:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390a39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269777792:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790656584.098049:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656584.098059:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.098087:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cfe00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656584.098093:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.098104:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.098124:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.098133:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5bff238/0x9c3a6e82066eb3a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.098167:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656584.098169:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656584.098171:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656584.098645:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+15:10527:x1877639248797696:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 67471us (67751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.098655:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1790656584.100131:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3301:x1877639269777920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4627us (5246us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790656584.100142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1790656584.103659:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943928241c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1790656584.103672:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269777920:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790656584.108117:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656584.108229:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269778048:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656584.108257:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.108508:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656584.108589:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797952 00000100:00100000:3.0:1790656584.108610:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797952 00000100:00100000:3.0:1790656584.108662:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1790656584.108671:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+12:2342:x1877639248797952:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790656584.110734:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248797824 00000100:00100000:0.0:1790656584.110745:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248797824 00010000:00010000:0.0:1790656584.110782:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 13 pid: 8825 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.110823:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1790656584.110845:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+13:2341:x1877639248797824:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656584.110859:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656584.110865:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 13 pid: 8825 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.110879:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 13 pid: 8825 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.110901:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5bc751d/0x9c3a6e82066eb15d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237818 expref: 13 pid: 8825 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.110916:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656584.110922:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656584.110927:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.110935:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.110960:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656584.111010:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+12:2341:x1877639248797824:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 168us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.111018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00010000:00010000:0.0:1790656584.111914:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.111944:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.111953:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.111961:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.111978:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790656584.114979:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1877639269777664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19980us (20558us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790656584.114991:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1790656584.115138:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656584.115146:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.115157:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656584.115161:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.115171:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.115189:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.115224:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb39b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.115245:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656584.115247:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656584.115249:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790656584.122185:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94390a398380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790656584.122215:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390a398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269777664:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1790656584.165960:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1790656584.165975:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1790656584.165984:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1790656584.166547:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248797952:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 57870us (58032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656584.166557:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1790656584.178400:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656584.178615:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798208 00000100:00100000:2.0:1790656584.178624:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798208 00000100:00100000:2.0:1790656584.178678:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:2.0:1790656584.178696:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+15:10527:x1877639248798208:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790656584.178747:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656584.178772:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ab expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.178791:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:2.0:1790656584.178797:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656584.178824:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.178837:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.178846:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656584.179094:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ad52c2f reply state 00000000d7d0a742 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.179104:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656584.179674:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+16:10527:x1877639248798208:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 985us (1289us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1790656584.179683:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1790656584.185729:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1790656584.185816:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185829:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185838:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185845:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656584.185850:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185858:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185873:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:3.0:1790656584.185876:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656584.185889:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.185896:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb3a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.185966:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798336 00000100:00100000:0.0:1790656584.185975:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798336 00000100:00100000:0.0:1790656584.186028:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1790656584.186038:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248798336:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790656584.186294:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790656584.186298:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790656583 -> 1790656582 00002000:00010000:0.0:1790656584.186300:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790656582 00002000:00010000:0.0:1790656584.186303:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790656583 -> 1790656582 00002000:00010000:0.0:1790656584.186305:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790656584.187398:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2339:x1877639248798336:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 1349us (1664us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790656584.187407:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1790656584.195001:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656584.195074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798592 00000100:00100000:1.0:1790656584.195085:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798592 00000100:00100000:1.0:1790656584.195191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:1.0:1790656584.195211:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+15:10527:x1877639248798592:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790656584.195272:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.195288:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.195297:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.195331:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.195346:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 15 pid: 5845 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.195359:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393be16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269778176:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656584.195444:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656584.199019:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656584.199087:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798720 00000100:00100000:3.0:1790656584.199095:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798720 00010000:00010000:3.0:1790656584.199133:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 16 pid: 5845 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656584.199173:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1790656584.199182:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+16:2342:x1877639248798720:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656584.199204:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656584.199211:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 16 pid: 5845 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.199225:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 16 pid: 5845 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.199247:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:3.0:1790656584.199252:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.199260:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.199267:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.199302:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656584.199354:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+16:2342:x1877639248798720:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 173us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656584.199361:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00010000:00010000:1.0:1790656584.199932:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb36a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23789d expref: 15 pid: 5845 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.199950:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393be16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269778176:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656584.199970:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.199989:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.199996:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200024:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200030:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200038:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656584.200048:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200056:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200066:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:1.0:1790656584.200069:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790656584.200073:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.200079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb3b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.200132:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+14:10527:x1877639248798592:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 4924us (5139us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790656584.200148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:2.0:1790656584.203576:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.203676:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798848 00000100:00100000:0.0:1790656584.203694:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798848 00000100:00100000:0.0:1790656584.203750:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1790656584.203759:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248798848:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790656584.203813:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.203834:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.203843:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656584.203847:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656584.203852:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.203884:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.203909:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 7 pid: 6691 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.203924:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269778304:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656584.203997:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656584.207808:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.208008:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269778304:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656584.208034:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.208110:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248798976 00000100:00100000:1.0:1790656584.208118:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248798976 00010000:00010000:1.0:1790656584.208162:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 8 pid: 6691 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656584.208207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1790656584.208217:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248798976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656584.208231:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656584.208253:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 8 pid: 6691 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.208264:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 8 pid: 6691 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.208288:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd9b93ad/0x9c3a6e82066eb394 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378b9 expref: 8 pid: 6691 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.208304:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656584.208308:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656584.208314:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.208324:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656584.208372:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656584.208443:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248798976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 227us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656584.208450:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00010000:00010000:0.0:1790656584.208559:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208626:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208651:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208659:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208668:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208676:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656584.208680:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208700:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208713:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.208721:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a36d65/0x9c3a6e82066eb3b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.208777:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248798848:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 5018us (5219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.208785:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1790656584.212413:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656584.212799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248799232 00000100:00100000:1.0:1790656584.212809:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248799232 00000100:00100000:2.0:1790656584.212961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:2.0:1790656584.212971:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+14:10527:x1877639248799232:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790656584.213046:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213065:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213076:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213561:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213584:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213622:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213657:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.213670:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 15 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.213706:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928428000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269778432:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656584.213786:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656584.216825:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928428000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269778432:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656584.216851:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.219067:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.219161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248799360 00000100:00100000:0.0:1790656584.219170:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248799360 00010000:00010000:0.0:1790656584.219735:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 16 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.219777:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1790656584.219787:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+16:2341:x1877639248799360:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656584.219801:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656584.219808:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 16 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219821:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 16 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219843:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378a4 expref: 16 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219857:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:0.0:1790656584.219862:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219871:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219894:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.219925:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656584.219972:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+15:2341:x1877639248799360:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 186us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.219979:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00010000:00010000:3.0:1790656584.220116:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.220125:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790656584.220309:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1790656584.220458:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1790656584.220498:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1790656584.220576:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877639269778560:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790656584.220656:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656584.220695:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38000 going to sleep for 11 seconds 00000100:00100000:1.0:1790656584.220835:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269778560 00000100:00100000:1.0:1790656584.220842:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269778560 00000100:00100000:1.0:1790656584.220881:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790656584.220889:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877639269778560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790656584.220969:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877639269778560:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656584.220975:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790656584.221312:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1790656584.221317:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1790656584.221335:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94390a39bb80, transno 4294967309 00000004:00080000:3.0:1790656584.221392:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94390a398380, transno 4294967310 00000100:00100000:3.0:1790656584.224853:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877639269778560:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790656584.230099:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790656584.230324:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392842b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877639269778688:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790656584.230399:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656584.230469:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790656584.230511:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269778688 00000100:00100000:1.0:1790656584.230519:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269778688 00000100:00100000:3.0:1790656584.231103:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656584.231325:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877639269778688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790656584.231644:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1877639269778688:12345-0@lo:1000:mdt00_001.0 Request processed in 523us (1244us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790656584.231652:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790656584.231786:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392842b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1877639269778688:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790656584.231820:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231830:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231837:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231842:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656584.231847:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231854:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231869:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836db00) 00010000:00010000:3.0:1790656584.231872:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656584.231877:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231883:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb3c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231922:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231930:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231936:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231948:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656584.231952:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231959:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231969:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656584.231971:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656584.231979:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231990:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.231999:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.232029:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656584.232041:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269778816:192.168.203.23@tcp:105: 00000100:00100000:3.0:1790656584.232157:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903229240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656584.237136:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.237313:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248799488 00000100:00100000:0.0:1790656584.237322:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248799488 00000100:00100000:0.0:1790656584.237378:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1790656584.237398:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+19:10526:x1877639248799488:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:0.0:1790656584.237516:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+19:10526:x1877639248799488:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.237524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:3.0:1790656584.239827:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269778816:192.168.203.23@tcp:105: 00010000:00010000:3.0:1790656584.239857:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239885:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb308 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239917:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239930:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239940:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239951:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239957:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239963:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239969:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656584.239973:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239980:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.239990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656584.239992:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656584.239995:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240007:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb3cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240017:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240023:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240029:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240034:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656584.240037:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240042:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240049:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656584.240051:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790656584.240054:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.240060:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb3be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656584.240396:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+18:10527:x1877639248799232:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 27415us (27980us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1790656584.240406:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000020:00080000:3.0:1790656584.240419:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790656584.240633:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656584.240637:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656584.240663:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790656584.240669:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790656584.243427:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.243509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248799744 00000100:00100000:0.0:1790656584.243519:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248799744 00000100:00100000:0.0:1790656584.243580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:0.0:1790656584.243626:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+18:10526:x1877639248799744:12345-192.168.203.23@tcp:58:lfs.0 00000040:00080000:0.0:1790656584.244025:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790656584.244100:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+18:10526:x1877639248799744:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 511us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656584.244108:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:2.0:1790656584.247625:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.247766:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800000 00000100:00100000:0.0:1790656584.247775:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800000 00000100:00100000:0.0:1790656584.247832:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1790656584.247842:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+18:10527:x1877639248800000:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790656584.248853:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790656584.248959:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1790656584.249005:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249020:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249031:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249040:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249046:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249053:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.249079:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790656584.249211:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+20:10527:x1877639248800000:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1369us (1617us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1790656584.249219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000020:00080000:0.0:1790656584.249225:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790656584.249367:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656584.249374:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.249381:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656584.249395:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.249403:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.249415:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656584.249425:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790656584.249431:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.249436:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb3d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.249452:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656584.249454:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656584.249455:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656584.291894:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656584.292019:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800128 00000100:00100000:0.0:1790656584.292028:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800128 00000100:00100000:0.0:1790656584.292096:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:0.0:1790656584.292105:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+20:10529:x1877639248800128:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656584.292128:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656584.292156:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb3da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378c0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292230:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292253:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292265:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292281:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292288:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292295:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292520:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292541:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292550:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292587:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656584.292631:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 21 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656584.292643:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269778944:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656584.292729:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656584.299963:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656584.300034:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800384 00000100:00100000:1.0:1790656584.300043:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800384 00000100:00100000:1.0:1790656584.300099:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1790656584.300108:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+22:5580:x1877639248800384:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790656584.300329:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+23:5580:x1877639248800384:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 221us (373us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1790656584.300337:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1790656584.300626:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269778944:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656584.300652:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656584.309158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656584.309284:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800512 00000100:00100000:3.0:1790656584.309294:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800512 00010000:00010000:3.0:1790656584.309334:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 23 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656584.309374:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1790656584.309393:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+23:2342:x1877639248800512:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656584.309408:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656584.309415:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 23 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309429:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 23 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309451:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb2fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237881 expref: 23 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309467:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656584.309472:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309481:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309490:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656584.309521:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656584.309628:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+22:2342:x1877639248800512:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 211us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656584.309635:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00010000:00010000:2.0:1790656584.309822:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309831:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656584.309867:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790656584.309871:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656584.309888:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309899:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309908:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309915:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309921:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309935:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656584.309939:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309946:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309955:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:2.0:1790656584.309958:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656584.309962:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309968:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb3e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309979:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309985:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309991:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.309996:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656584.309999:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310005:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310021:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94391836d500) 00010000:00010000:2.0:1790656584.310024:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656584.310026:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310032:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb3e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310065:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb3da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c0 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310077:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c0 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656584.310083:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656584.310086:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656584.310088:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507600, rc 0) 00000100:00100000:2.0:1790656584.310110:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+21:10529:x1877639248800128:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 18008us (18227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656584.310117:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00010000:00010000:0.0:1790656584.415716:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790656584.971635:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1790656584.971668:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1790656584.971676:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:0.0:1790656585.248964:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656585.248978:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656585.249021:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790656585.249031:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790656585.249196:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269779072:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790656585.249516:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1790656585.256835:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656585.256943:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800640 00000100:00100000:1.0:1790656585.256955:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800640 00000100:00100000:1.0:1790656585.257033:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:1.0:1790656585.257057:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+22:10540:x1877639248800640:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790656585.257122:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790656585.258440:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+22:10540:x1877639248800640:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 1375us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656585.258455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00080000:1.0:1790656585.258511:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656585.265666:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f47c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269779072:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790656585.274673:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656585.274734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248800896 00000100:00100000:3.0:1790656585.274748:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248800896 00000100:00100000:3.0:1790656585.274833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:3.0:1790656585.274846:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+21:10540:x1877639248800896:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656585.274874:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656585.274902:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb3f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.275047:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb3fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.275066:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.275085:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656585.275098:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790656585.275283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb3f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c7 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.275303:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c7 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.275312:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:3.0:1790656585.275328:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656585.275333:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656585.275426:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+23:10540:x1877639248800896:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 581us (766us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1790656585.275434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:1.0:1790656585.279883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656585.280675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248801152 00000100:00100000:0.0:1790656585.280693:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248801152 00000100:00100000:0.0:1790656585.280777:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:0.0:1790656585.280811:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+23:10540:x1877639248801152:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790656585.280922:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.280943:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.280958:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281189:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281197:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281203:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281210:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656585.281215:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281237:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656585.281255:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656585.281261:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.281267:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb40b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656585.281969:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656585.282253:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248801280 00000100:00100000:2.0:1790656585.282263:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248801280 00000100:00100000:2.0:1790656585.282330:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1790656585.282348:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+25:2342:x1877639248801280:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656585.282362:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656585.282391:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb3fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c7 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656585.282421:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:2.0:1790656585.282425:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656585.282556:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+24:2342:x1877639248801280:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 216us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656585.282564:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1790656585.283125:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+23:10540:x1877639248801152:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 2315us (3248us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790656585.283137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000040:00080000:0.0:1790656585.287046:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656585.287058:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656585.287745:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790656585.287757:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790656585.292279:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656585.295072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248801536 00000100:00100000:1.0:1790656585.295085:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248801536 00000100:00100000:0.0:1790656585.295321:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1790656585.295341:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+23:10540:x1877639248801536:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790656585.295738:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+24:10540:x1877639248801536:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 403us (3467us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1790656585.295750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000040:00080000:1.0:1790656585.351213:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656585.351323:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656585.351389:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790656585.351398:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790656585.442427:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656585.554957:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656585.554996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248801792 00000100:00100000:0.0:1790656585.555005:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248801792 00000100:00100000:0.0:1790656585.555055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1790656585.555065:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+24:10554:x1877639248801792:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656585.555088:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656585.555109:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378ce expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.555203:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.555218:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.555243:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656585.555256:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790656585.555393:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ce expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.555409:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ce expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656585.555417:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:0.0:1790656585.555420:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790656585.555424:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506c00, rc 0) 00000100:00100000:0.0:1790656585.555473:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+26:10554:x1877639248801792:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 410us (526us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790656585.555480:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1790656585.558627:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656585.558772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248801920 00000100:00100000:1.0:1790656585.558781:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248801920 00000100:00100000:1.0:1790656585.558835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1790656585.558845:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+26:10554:x1877639248801920:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1790656585.558904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558920:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558932:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558959:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558966:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558979:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558985:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cec00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656585.558989:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.558997:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.559010:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656585.559013:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656585.559018:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656585.559024:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656585.559094:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+26:10554:x1877639248801920:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 250us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656585.559101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:0.0:1790656585.675292:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656585.675391:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802048 00000100:00100000:3.0:1790656585.675401:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802048 00000100:00100000:3.0:1790656585.675470:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1790656585.675482:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248802048:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1790656585.675498:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656585.675518:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb42e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378d5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656585.675545:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abb4046, atime: 0x6abb4046, ctime: 0x6abb4046, blocks: 0xb 00010000:00010000:3.0:1790656585.675564:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1790656585.675568:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656585.675578:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb42e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378d5 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.675641:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb42e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378d5 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656585.675654:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96c00, rc 0) 00000100:00100000:3.0:1790656585.675709:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248802048:12345-192.168.203.23@tcp:101:cat.0 Request processed in 230us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656585.675733:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00080000:1.0:1790656585.675747:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656585.688792:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656585.689848:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802176 00000100:00100000:0.0:1790656585.689858:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802176 00002000:00100000:0.0:1790656585.689909:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94393be14000 x1877639248802176/t0(0) o3->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:446/0 lens 488/0 e 0 to 0 dl 1790656596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656585.689920:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393be14000 with x1877639248802176 ext(0->4095) 00002000:00010000:0.0:1790656585.689925:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393be14000 00000100:00100000:0.0:1790656585.689961:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1790656585.689971:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+7:2340:x1877639248802176:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:0.0:1790656585.690517:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+7:2340:x1877639248802176:12345-192.168.203.23@tcp:3:cat.0 Request processed in 545us (1732us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790656585.690525:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:0.0:1790656585.690532:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94393be14000 x1877639248802176/t0(0) o3->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:446/0 lens 488/4536 e 0 to 0 dl 1790656596 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656585.690540:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393be14000 with x1877639248802176 ext(0->4095) 00002000:00010000:0.0:1790656585.690544:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393be14000 00010000:00010000:0.0:1790656586.465621:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656586.911027:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392842a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269779200:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911122:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911183:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269779712:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911217:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911254:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790656586.911260:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392842b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269779328:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911295:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911328:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269779840:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911398:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269779456:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911442:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656586.911448:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269779584:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911469:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656586.911514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779712 00000100:00100000:3.0:1790656586.911524:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779712 00000100:00100000:3.0:1790656586.911616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779328 00000100:00100000:3.0:1790656586.911620:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779328 00000100:00100000:3.0:1790656586.911640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779456 00000100:00100000:3.0:1790656586.911642:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779456 00000100:00100000:3.0:1790656586.911661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790656586.911793:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269779712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911860:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269779712:12345-0@lo:400:kworker.0 Request processed in 71us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656586.911867:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790656586.911907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790656586.911913:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269779328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911942:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269779328:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656586.911949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790656586.911962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790656586.911969:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.911996:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269779456:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656586.912003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790656586.912022:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779840 00000100:00100000:3.0:1790656586.912026:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779840 00000100:00100000:3.0:1790656586.912051:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779584 00000100:00100000:3.0:1790656586.912054:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779584 00000100:00100000:3.0:1790656586.912074:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790656586.912080:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269779840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912109:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269779840:12345-0@lo:400:kworker.0 Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656586.912115:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790656586.912127:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790656586.912133:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269779584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912165:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269779584:12345-0@lo:400:kworker.0 Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656586.912172:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1790656586.912199:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656586.912205:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656586.912208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656586.912269:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269779584:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912280:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269779456:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912318:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392842b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269779328:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912328:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1790656586.912334:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1790656586.912352:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94393bb39180, transno 4294967301 00000004:00080000:3.0:1790656586.912384:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1790656586.912398:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943928241c00, transno 4294967304 00000100:00100000:3.0:1790656586.912403:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269779840:0@lo:400:kworker.0 00000100:00100000:3.0:1790656586.912416:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269779712:0@lo:400:kworker.0 00000100:00100000:2.0:1790656586.913002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779200 00000100:00100000:2.0:1790656586.913021:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779200 00000100:00100000:2.0:1790656586.913066:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790656586.913075:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656586.913139:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269779200:12345-0@lo:400:kworker.0 Request processed in 65us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656586.913147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790656586.914747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269779968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656586.914819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656586.914929:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392842a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269779200:0@lo:400:kworker.0 00000100:00100000:2.0:1790656586.915607:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269779968 00000100:00100000:2.0:1790656586.915616:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269779968 00000100:00100000:2.0:1790656586.915738:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790656586.915750:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269779968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656586.915794:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656586.915865:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269779968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656586.915874:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790656586.915926:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269779968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790656587.486885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656588.453729:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943928241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269780096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790656588.453795:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656588.454023:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780096 00000100:00100000:2.0:1790656588.454040:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780096 00000100:00100000:2.0:1790656588.454146:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790656588.454156:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269780096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656588.454188:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656588.454235:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269780096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656588.454242:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790656588.454284:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943928241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269780096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790656588.455628:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656588.511839:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656588.538084:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656588.538121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656588.538188:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656588.538210:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656588.538247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802432 00000100:00100000:3.0:1790656588.538257:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802432 00000100:00100000:3.0:1790656588.538316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:3.0:1790656588.538326:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+26:2342:x1877639248802432:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656588.538408:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+26:2342:x1877639248802432:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656588.538415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00080000:3.0:1790656588.538435:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656588.540673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802304 00000100:00100000:3.0:1790656588.540687:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802304 00000100:00100000:3.0:1790656588.540741:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 285 00000100:00100000:3.0:1790656588.540751:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248802304:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656588.540822:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248802304:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656588.540830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 285 00000100:00100000:2.0:1790656588.544344:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656588.546685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802816 00000100:00100000:2.0:1790656588.546698:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802816 00000100:00100000:2.0:1790656588.546774:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:2.0:1790656588.546785:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248802816:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656588.546865:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248802816:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 80us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656588.546872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1790656588.552386:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802688 00000100:00100000:1.0:1790656588.552407:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802688 00000100:00100000:1.0:1790656588.552473:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802560 00000100:00100000:1.0:1790656588.552476:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802560 00000100:00100000:1.0:1790656588.552509:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1790656588.552519:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248802688:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656588.552611:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248802688:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (14488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656588.552618:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1790656588.552634:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1790656588.552641:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248802560:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656588.552665:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248802560:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (14455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656588.552672:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00080000:3.0:1790656588.553311:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656588.553316:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656588.553319:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656589.539676:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790656589.588714:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:2.0:1790656589.590339:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1790656589.590368:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:2.0:1790656589.594573:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943908f7cc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790656589.594586:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94380115da00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943908f7ce40 00000020:00080000:2.0:1790656589.594631:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94380115dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94393586bc00 00000020:00080000:3.0:1790656589.594676:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:2.0:1790656589.594693:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790656589.594993:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1790656590.366857:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656590.367016:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248802944 00000100:00100000:3.0:1790656590.367029:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248802944 00000100:00100000:3.0:1790656590.367174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:3.0:1790656590.367190:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+13:10215:x1877639248802944:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790656590.367326:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+13:10215:x1877639248802944:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 141us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656590.367334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00080000:0.0:1790656590.367396:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656590.375270:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656590.375388:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803200 00000100:00100000:0.0:1790656590.375402:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803200 00000100:00100000:0.0:1790656590.375475:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1790656590.375487:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+13:10215:x1877639248803200:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790656590.376001:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+14:10215:x1877639248803200:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 514us (744us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790656590.376011:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00010000:00010000:1.0:1790656590.558805:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656591.585719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656592.032414:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269780352:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032475:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656592.032523:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269780864:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656592.032656:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790656592.032669:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269780224:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656592.032734:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269780736:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656592.032789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780224 00000100:00100000:3.0:1790656592.032802:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780224 00000100:00100000:0.0:1790656592.032810:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269780480:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656592.032867:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269780992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656592.032881:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790656592.032895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656592.032911:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032922:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656592.032931:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bc41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269780608:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.032953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656592.033041:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780352 00000100:00100000:2.0:1790656592.033050:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780352 00000100:00100000:2.0:1790656592.033113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780736 00000100:00100000:2.0:1790656592.033118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780736 00000100:00100000:2.0:1790656592.033146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780480 00000100:00100000:2.0:1790656592.033149:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780480 00000100:00100000:2.0:1790656592.033171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790656592.033181:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269780352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.037906:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780864 00000100:00100000:0.0:1790656592.037919:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780864 00000100:00100000:0.0:1790656592.037979:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780608 00000100:00100000:0.0:1790656592.037982:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780608 00000100:00100000:0.0:1790656592.038005:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790656592.038013:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269780864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.041267:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269780224:12345-0@lo:400:kworker.0 Request processed in 8362us (8543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656592.041287:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790656592.041566:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790656592.041586:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269780736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.043839:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269780736:12345-0@lo:400:kworker.0 Request processed in 2246us (11052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656592.043883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790656592.045074:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790656592.045101:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.045243:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269780480:12345-0@lo:400:kworker.0 Request processed in 155us (12395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656592.045250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790656592.045291:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790656592.045301:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269780608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.045352:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269780608:12345-0@lo:400:kworker.0 Request processed in 53us (12398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656592.045358:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790656592.045425:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1790656592.045433:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1790656592.045461:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269780608:0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.045477:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269780480:0@lo:400:kworker.0 00000100:00080000:3.0:1790656592.045582:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790656592.045588:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656592.045652:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656592.045670:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269780992 00000100:00100000:3.0:1790656592.047219:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269780992 00000100:00100000:3.0:1790656592.047323:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790656592.047347:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269780992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656592.047391:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656592.047483:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269780992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (14590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656592.047512:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790656592.047642:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269780992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656592.048524:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269780352:12345-0@lo:400:kworker.0 Request processed in 15337us (16040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656592.048537:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790656592.049066:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269780224:0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.049089:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269780736:0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.049102:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269780352:0@lo:400:kworker.0 00000100:00100000:3.0:1790656592.049115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269780864:0@lo:400:kworker.0 00000100:00100000:0.0:1790656592.052668:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269780864:12345-0@lo:400:kworker.0 Request processed in 14645us (20109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656592.052681:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000001:02000400:0.0:1790656592.409274:0:12255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:36:30 (1790656590) 00010000:00010000:1.0:1790656592.607875:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656593.572041:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656593.572244:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269781120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656593.572323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656593.572588:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269781120 00000100:00100000:3.0:1790656593.572622:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269781120 00000100:00100000:3.0:1790656593.572800:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790656593.572813:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269781120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656593.572847:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656593.572904:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269781120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656593.572911:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790656593.573000:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269781120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790656593.630909:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656593.665965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656593.666016:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656593.666053:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656593.666163:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803584 00000100:00100000:0.0:1790656593.666175:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803584 00000100:00100000:0.0:1790656593.666252:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1790656593.666264:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248803584:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656593.666365:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2339:x1877639248803584:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 103us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656593.666372:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1790656593.666774:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656593.666839:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803328 00000100:00100000:3.0:1790656593.666845:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803328 00000100:00100000:3.0:1790656593.666890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 287 00000100:00100000:3.0:1790656593.666898:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248803328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656593.666938:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2339:x1877639248803328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656593.666945:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 287 00000100:00080000:3.0:1790656593.666977:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656593.671867:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656593.672031:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803712 00000100:00100000:0.0:1790656593.672044:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803712 00000100:00100000:0.0:1790656593.672126:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1790656593.672138:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248803712:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656593.672238:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2339:x1877639248803712:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656593.672245:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00080000:2.0:1790656593.673180:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656593.673944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803840 00000100:00100000:1.0:1790656593.673957:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803840 00000100:00100000:1.0:1790656593.674088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248803456 00000100:00100000:1.0:1790656593.674092:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248803456 00000100:00100000:3.0:1790656593.674162:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:3.0:1790656593.674193:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248803840:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656593.674280:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2339:x1877639248803840:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (8225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656593.674289:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00080000:2.0:1790656593.674992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656593.675422:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:1.0:1790656593.675435:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+14:2339:x1877639248803456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656593.675520:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+14:2339:x1877639248803456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 88us (8746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656593.675528:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:0.0:1790656593.852671:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656593.852852:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804096 00000100:00100000:3.0:1790656593.852866:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804096 00000100:00100000:3.0:1790656593.852954:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:3.0:1790656593.852969:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+14:11263:x1877639248804096:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656593.852998:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656593.853025:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb435 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378dc expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853130:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853147:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853372:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853394:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853402:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853409:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853778:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb44a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853789:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb44a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.853796:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb44a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656593.853808:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790656593.854074:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854083:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854090:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854097:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656593.854101:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854110:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854125:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94391836df00) 00010000:00010000:3.0:1790656593.854128:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656593.854134:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854152:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb43c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854366:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854372:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854379:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854385:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656593.854388:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854395:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854404:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9439086c3f00) 00010000:00010000:3.0:1790656593.854407:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656593.854411:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.854417:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb443 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.855742:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb435 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378dc expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.855770:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb44a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378dc expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656593.855787:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:3.0:1790656593.855790:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656593.855794:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656593.855948:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+16:11263:x1877639248804096:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2980us (3289us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790656593.855957:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:0.0:1790656593.874734:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656593.874794:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656593.874909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804224 00000100:00100000:1.0:1790656593.874923:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804224 00000100:00100000:2.0:1790656593.874932:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804352 00000100:00100000:2.0:1790656593.874936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804352 00000100:00100000:2.0:1790656593.875005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1790656593.875005:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:2.0:1790656593.875018:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+17:2340:x1877639248804352:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790656593.875018:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+17:11263:x1877639248804224:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00010000:00010000:2.0:1790656593.875062:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656593.875100:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb44a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378dc expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656593.875126:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:2.0:1790656593.875132:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656593.875152:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+16:2340:x1877639248804352:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 137us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656593.875153:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+16:11263:x1877639248804224:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 138us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656593.875161:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1790656593.875161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 137 00000040:00080000:1.0:1790656594.527941:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656594.527954:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656594.531370:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790656594.531389:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790656594.656394:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790656594.686222:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000001:00080000:3.0:1790656594.686284:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1790656594.686293:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1790656594.686358:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790656594.686372:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1790656595.678854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656595.721947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656595.722222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804480 00000100:00100000:1.0:1790656595.722233:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804480 00000100:00100000:1.0:1790656595.722324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:1.0:1790656595.722336:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+13:11305:x1877639248804480:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656595.722362:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656595.722388:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722481:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722497:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722535:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722549:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722922:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722931:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722937:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722943:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656595.722948:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722955:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722967:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:1.0:1790656595.722970:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656595.722975:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.722989:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb45f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.723002:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.723008:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.723014:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.723019:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656595.723023:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790656595.723810:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790656595.724224:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.724243:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9439148d8400) 00010000:00010000:1.0:1790656595.724246:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656595.724251:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.724256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb466 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.724312:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb458 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378e3 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.724339:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:1.0:1790656595.724342:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656595.724346:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378e3 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.724356:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cec00, rc 0) 00000100:00100000:1.0:1790656595.724427:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+13:11305:x1877639248804480:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2093us (2494us total) trans 0 rc 301/301 00000100:00100000:1.0:1790656595.724436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:1.0:1790656595.734648:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656595.736067:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804736 00000100:00100000:3.0:1790656595.736087:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804736 00000100:00100000:3.0:1790656595.736163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:3.0:1790656595.736182:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+13:11305:x1877639248804736:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1790656595.736248:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656595.736283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eade4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237723 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736309:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943909b4a200) 00010000:00010000:3.0:1790656595.736320:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656595.736555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736569:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736585:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736644:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736835:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.736846:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656595.740412:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790656595.740432:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740442:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740450:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740456:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656595.740460:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740467:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740481:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656595.740484:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656595.740488:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.740506:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb46d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656595.740527:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005223766b reply state 00000000e9bbbf98 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656595.740535:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656595.744694:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+14:11305:x1877639248804736:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 8513us (10045us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790656595.744708:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00010000:00010000:0.0:1790656595.775719:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775737:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775745:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775760:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656595.775766:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775774:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775791:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9439086c3900) 00010000:00010000:0.0:1790656595.775795:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656595.775809:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.775816:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb474 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656595.860337:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656595.860415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804864 00000100:00100000:0.0:1790656595.860426:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804864 00000100:00100000:0.0:1790656595.860483:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:0.0:1790656595.860493:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+13:11313:x1877639248804864:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:0.0:1790656595.860516:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656595.860537:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb47b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378ea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861316:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861328:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656595.861363:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790656595.861367:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656595.861386:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861410:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb47b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ea expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861447:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ea expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.861455:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:1.0:1790656595.861459:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656595.861462:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506000, rc 0) 00000100:00100000:1.0:1790656595.861552:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+14:11313:x1877639248804864:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 1060us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656595.861559:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:2.0:1790656595.931923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656595.932033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248804992 00000100:00100000:0.0:1790656595.932043:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248804992 00000100:00100000:0.0:1790656595.932172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:0.0:1790656595.932184:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+14:11319:x1877639248804992:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656595.932205:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656595.932226:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378f1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932292:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932319:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932333:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932369:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932377:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932492:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932499:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656595.932526:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790656595.932530:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656595.932548:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932560:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932567:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932573:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932640:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656595.932644:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932652:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932676:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:0.0:1790656595.932680:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656595.932685:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932693:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932707:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932713:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932718:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932724:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656595.932727:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932733:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932753:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94391836d100) 00010000:00010000:0.0:1790656595.932756:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656595.932759:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932765:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb497 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932797:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f1 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932811:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f1 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656595.932818:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656595.932820:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790656595.932822:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506600, rc 0) 00000100:00100000:0.0:1790656595.932875:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+15:11319:x1877639248804992:12345-192.168.203.23@tcp:101:bash.0 Request processed in 694us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656595.932883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:3.0:1790656595.940279:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656595.940746:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248805248 00000100:00100000:2.0:1790656595.940756:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248805248 00000100:00100000:2.0:1790656595.940856:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:2.0:1790656595.940866:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+15:11319:x1877639248805248:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656595.940887:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656595.940906:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb4a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378f8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941025:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941047:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941064:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941129:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941148:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941155:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790656595.941745:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790656595.941899:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941909:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941917:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941945:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941952:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941958:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941964:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656595.941968:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941975:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.941995:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656595.941998:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656595.942003:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.942009:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb4ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656595.942020:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007deb659 reply state 00000000c3cc44c7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656595.942028:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790656595.942055:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb4a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.942067:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656595.942075:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:2.0:1790656595.942077:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656595.942080:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656595.942140:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+18:11319:x1877639248805248:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1275us (1869us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790656595.942147:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:3.0:1790656595.950311:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656595.950346:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248805376 00000100:00100000:3.0:1790656595.950357:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248805376 00000100:00100000:3.0:1790656595.950420:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1790656595.950430:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248805376:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656595.950448:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656595.950467:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2378ff expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656595.950493:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656595.950511:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1790656595.950516:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656595.950524:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.950541:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.950567:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656595.950640:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248805376:12345-192.168.203.23@tcp:101:bash.0 Request processed in 211us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656595.950648:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00080000:3.0:1790656595.950758:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790656595.950923:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950933:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950940:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950946:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656595.950950:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950958:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950971:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943909b4a900) 00010000:00010000:1.0:1790656595.950974:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656595.950978:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.950992:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb4b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656595.961910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656595.964854:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248805504 00000100:00100000:3.0:1790656595.964868:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248805504 00000100:00100000:3.0:1790656595.964978:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1790656595.964989:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:11319:x1877639248805504:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656595.965005:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656595.965023:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237906 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.965116:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.965126:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656595.965130:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656595.965135:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.965168:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.965183:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 7 pid: 6690 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656595.965211:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269781248:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656595.965314:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656595.968810:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656595.968986:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248805632 00000100:00100000:3.0:1790656595.968995:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248805632 00010000:00010000:3.0:1790656595.969043:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 8 pid: 6690 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656595.969085:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:3.0:1790656595.969095:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+8:2340:x1877639248805632:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656595.969109:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656595.969129:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 8 pid: 6690 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.969144:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 8 pid: 6690 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.969169:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656595.969173:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656595.969182:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.969192:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656595.969246:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656595.969260:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877639269781376:192.168.203.23@tcp:105: 00000100:00100000:3.0:1790656595.969340:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7c6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790656595.969809:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e95dec8/0x9c3a6e82066eb4c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ff expref: 8 pid: 6690 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656595.969825:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269781248:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656595.969848:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656595.969859:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:1.0:1790656595.969900:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:11319:x1877639248805504:12345-192.168.203.23@tcp:101:bash.0 Request processed in 4913us (7999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656595.969909:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:2.0:1790656595.975904:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656595.976038:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1877639269781376:192.168.203.23@tcp:105: 00010000:00010000:3.0:1790656595.976072:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656595.976131:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+6:2340:x1877639248805632:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 7036us (7327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656595.976142:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1790656595.976449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248805888 00000100:00100000:1.0:1790656595.976457:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248805888 00000100:00100000:1.0:1790656595.976498:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1790656595.976509:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+17:11319:x1877639248805888:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1790656595.976935:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+18:11319:x1877639248805888:12345-192.168.203.23@tcp:35:bash.0 Request processed in 428us (1041us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790656595.976943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1790656596.072660:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656596.072835:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248806144 00000100:00100000:0.0:1790656596.072845:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248806144 00000100:00100000:0.0:1790656596.072903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:0.0:1790656596.072913:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+18:11329:x1877639248806144:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656596.072937:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656596.072957:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb4d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23790d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656596.073051:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790656596.073345:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb4d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23790d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.073359:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:0.0:1790656596.073362:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656596.073367:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb4d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23790d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.073380:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506e00, rc 0) 00000100:00100000:0.0:1790656596.073441:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+19:11329:x1877639248806144:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 529us (789us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1790656596.073447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:3.0:1790656596.082341:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.082435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248806400 00000100:00100000:2.0:1790656596.082474:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248806400 00000100:00100000:2.0:1790656596.082540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1790656596.082550:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+19:11329:x1877639248806400:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656596.083024:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+20:11329:x1877639248806400:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 474us (692us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1790656596.083033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1790656596.183201:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656596.183320:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248806528 00000100:00100000:1.0:1790656596.183330:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248806528 00000100:00100000:1.0:1790656596.183387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:1.0:1790656596.183398:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+20:11335:x1877639248806528:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656596.183435:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656596.183456:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb4e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237914 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183520:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183535:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183546:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656596.183580:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790656596.183583:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656596.183643:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183668:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb4e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237914 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183687:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237914 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.183695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656596.183699:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656596.183703:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce000, rc 0) 00000100:00100000:1.0:1790656596.183833:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+21:11335:x1877639248806528:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 437us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656596.183841:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:0.0:1790656596.196682:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.197636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248806784 00000100:00100000:3.0:1790656596.197660:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248806784 00000100:00100000:3.0:1790656596.197970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:3.0:1790656596.197981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+21:11335:x1877639248806784:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656596.198001:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656596.198022:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb4f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23791b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.198130:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb4f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.198146:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.198158:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656596.198183:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790656596.198327:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb4f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23791b expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.198345:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23791b expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.198353:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:3.0:1790656596.198356:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656596.198360:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96200, rc 0) 00000100:00100000:3.0:1790656596.199544:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+23:11335:x1877639248806784:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1559us (2866us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1790656596.199553:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:3.0:1790656596.204936:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.204986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656596.205199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807040 00000100:00100000:1.0:1790656596.205209:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807040 00000100:00100000:1.0:1790656596.205266:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:1.0:1790656596.205277:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+23:11335:x1877639248807040:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656596.205318:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656596.205339:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237922 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.205444:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.205458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.205471:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656596.205481:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790656596.205646:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237922 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.205673:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237922 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.205682:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:1.0:1790656596.205686:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790656596.205689:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce800, rc 0) 00000100:00100000:1.0:1790656596.205742:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+25:11335:x1877639248807040:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 467us (814us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790656596.206500:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:0.0:1790656596.206676:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807168 00000100:00100000:0.0:1790656596.206682:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807168 00000100:00100000:0.0:1790656596.206728:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1790656596.206738:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+25:2340:x1877639248807168:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656596.206759:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656596.206778:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb4f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23791b expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.206792:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:0.0:1790656596.206796:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656596.206833:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+24:2340:x1877639248807168:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 96us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656596.206846:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656596.214706:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656596.214893:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807296 00000100:00100000:0.0:1790656596.214916:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807296 00000100:00100000:0.0:1790656596.214974:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1790656596.214985:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248807296:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:0.0:1790656596.215031:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.215051:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.215071:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656596.215076:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790656596.215080:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.215118:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.215132:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 6 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656596.215146:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1877639269781504:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656596.215237:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54840 going to sleep for 11 seconds 00000100:00100000:1.0:1790656596.223176:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656596.224310:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1877639269781504:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656596.224354:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656596.229135:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807424 00000100:00100000:3.0:1790656596.229285:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807424 00002000:00100000:3.0:1790656596.229357:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94393be14a80 x1877639248807424/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:457/0 lens 504/0 e 0 to 0 dl 1790656607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656596.229854:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393be14a80 with x1877639248807424 ext(0->12) 00010000:00010000:3.0:1790656596.229867:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 7 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.229884:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 7 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656596.229909:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94393be14a80 00000100:00100000:3.0:1790656596.230014:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656596.230025:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248807424:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:3.0:1790656596.230582:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248807424:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 557us (7413us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790656596.230614:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:3.0:1790656596.230623:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94393be14a80 x1877639248807424/t4294967305(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:457/0 lens 504/448 e 0 to 0 dl 1790656607 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656596.230632:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393be14a80 with x1877639248807424 ext(0->12) 00010000:00010000:3.0:1790656596.230639:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.230669:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656596.230677:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94393be14a80 00000100:00100000:1.0:1790656596.240025:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.240464:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807552 00000100:00100000:3.0:1790656596.240478:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807552 00010000:00010000:3.0:1790656596.240519:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656596.240564:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1790656596.240574:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248807552:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656596.240626:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790656596.240643:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790656596.240645:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790656595 00002000:00010000:3.0:1790656596.240648:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790656595 00002000:00010000:3.0:1790656596.241431:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790656595 00010000:00010000:3.0:1790656596.241444:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.241460:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.241484:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088fa069f/0x9c3a6e82066eb4cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237906 expref: 9 pid: 6692 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.241500:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656596.241504:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656596.241509:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.241520:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.241554:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656596.242136:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242148:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242177:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242186:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242194:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242201:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656596.242207:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242281:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242306:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.242325:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066eb51c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656596.242888:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248807296:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 27902us (28188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656596.242898:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1790656596.242982:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248807552:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1087us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656596.242993:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:1.0:1790656596.258546:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656596.259165:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807808 00000100:00100000:0.0:1790656596.259176:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807808 00000100:00100000:0.0:1790656596.259240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1790656596.259251:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+24:11335:x1877639248807808:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:0.0:1790656596.259321:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237922 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656596.259936:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1790656596.259993:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1790656596.262159:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1790656596.262466:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.262487:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.262495:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.262534:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.262565:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 28 pid: 6714 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656596.262579:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877639269781632:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656596.263398:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54840 going to sleep for 11 seconds 00000100:00100000:1.0:1790656596.280452:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.280926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248807936 00000100:00100000:2.0:1790656596.280936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248807936 00010000:00010000:2.0:1790656596.280978:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 29 pid: 6714 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656596.281024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1790656596.281033:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+29:2341:x1877639248807936:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656596.281049:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656596.281066:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 29 pid: 6714 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.281080:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 29 pid: 6714 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.281102:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:2.0:1790656596.281107:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.281117:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.281142:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.281162:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656596.281331:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+29:2341:x1877639248807936:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 181us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656596.281341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00010000:00010000:0.0:1790656596.286210:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb4ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f8 expref: 28 pid: 6714 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656596.287213:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877639269781632:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656596.287333:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.287345:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.287351:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656596.289117:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1790656596.289349:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1790656596.289537:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269781760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656596.289631:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656596.289694:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656596.290128:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269781760 00000100:00100000:1.0:1790656596.290136:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269781760 00000100:00100000:1.0:1790656596.290204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790656596.290225:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269781760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790656596.290317:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269781760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656596.290325:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656596.290969:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269781760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790656596.292002:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1790656596.292078:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269781888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656596.292136:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656596.292166:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2900 going to sleep for 11 seconds 00000100:00080000:3.0:1790656596.292249:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656596.292471:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269781888 00000100:00100000:1.0:1790656596.292486:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269781888 00000100:00100000:1.0:1790656596.292529:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790656596.292538:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269781888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790656596.292861:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bf83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269781888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790656596.292925:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1790656596.292963:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.292974:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.292982:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.292989:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656596.292993:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.293001:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.293016:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:3.0:1790656596.293019:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790656596.293024:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.293031:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb523 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656596.293210:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790656596.293341:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1790656596.293353:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311429760415ns, next at 312429758546ns, rc = 0 00000001:00080000:3.0:1790656596.293359:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1790656596.293583:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4a100) 00010000:00010000:3.0:1790656596.293586:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790656596.293622:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb50e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237922 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656596.293721:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+31:11335:x1877639248807808:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 34472us (35184us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1790656596.293730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000020:00080000:3.0:1790656596.293736:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790656596.294064:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877639269781888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 210us (610us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790656596.294075:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790656596.297047:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.297211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248808064 00000100:00100000:3.0:1790656596.297234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248808064 00000100:00100000:3.0:1790656596.297305:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:3.0:1790656596.297317:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+31:11335:x1877639248808064:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656596.297340:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656596.297363:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb52a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237929 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.297834:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237929 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.297852:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237929 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.297874:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656596.297877:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656596.297881:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656596.297934:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:11335:x1877639248808064:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 619us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656596.297957:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:1.0:1790656596.301291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.301818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248808320 00000100:00100000:3.0:1790656596.301829:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248808320 00000100:00100000:3.0:1790656596.301882:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1790656596.301891:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+32:11335:x1877639248808320:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656596.302933:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+33:11335:x1877639248808320:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 1039us (1648us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1790656596.302942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1790656596.394930:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.398848:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248808576 00000100:00100000:2.0:1790656596.398863:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248808576 00000100:00100000:2.0:1790656596.398977:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:2.0:1790656596.398987:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+33:11345:x1877639248808576:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656596.399010:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656596.399038:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237930 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656596.399122:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790656596.400776:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb531 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237930 expref: 35 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.400796:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:2.0:1790656596.400799:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656596.400805:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237930 expref: 35 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.400822:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481000, rc 0) 00000100:00100000:2.0:1790656596.400902:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:11345:x1877639248808576:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1915us (5981us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1790656596.400927:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:3.0:1790656596.406434:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.406500:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248808704 00000100:00100000:2.0:1790656596.406510:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248808704 00000100:00100000:2.0:1790656596.406567:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:2.0:1790656596.406577:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:11345:x1877639248808704:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656596.406671:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.406688:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.406700:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.406716:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.406724:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.406731:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407273:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407284:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407292:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656596.407455:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407467:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407483:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407489:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407495:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656596.407499:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407506:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407518:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656596.407520:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656596.407525:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407530:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb53f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407544:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407550:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407562:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407567:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656596.407570:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407576:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407584:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943909b4ad00) 00010000:00010000:2.0:1790656596.407586:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656596.407614:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407621:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407635:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407642:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407648:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407653:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656596.407656:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407673:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407681:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:2.0:1790656596.407683:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656596.407686:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.407692:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb54d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656596.407876:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:11345:x1877639248808704:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1298us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656596.407885:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:3.0:1790656596.413656:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656596.417303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248808960 00000100:00100000:1.0:1790656596.417575:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248808960 00000100:00100000:0.0:1790656596.419564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:0.0:1790656596.419578:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+34:11345:x1877639248808960:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1790656596.423541:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+35:11345:x1877639248808960:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 3956us (10322us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1790656596.423553:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656596.479897:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656596.479991:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248809216 00000100:00100000:1.0:1790656596.480001:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248809216 00000100:00100000:1.0:1790656596.480107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:1.0:1790656596.480132:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+35:11348:x1877639248809216:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656596.480158:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656596.480178:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237937 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480268:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480280:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480306:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480323:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480331:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480583:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.480709:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656596.480731:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790656596.485018:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485035:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485043:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485049:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656596.485054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485062:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485077:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656596.485080:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656596.485084:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485090:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb55b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485125:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485132:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485139:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485145:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cfe00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656596.485148:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485155:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485163:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439148d8400) 00010000:00010000:0.0:1790656596.485166:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656596.485169:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485175:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485235:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485253:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.485273:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656596.485275:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656596.485278:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cea00, rc 0) 00000100:00100000:0.0:1790656596.485984:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+37:11348:x1877639248809216:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 5852us (6094us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790656596.485995:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:3.0:1790656596.491200:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656596.491724:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248809344 00000100:00100000:0.0:1790656596.491734:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248809344 00000100:00100000:0.0:1790656596.491893:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:0.0:1790656596.491905:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+37:11348:x1877639248809344:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1790656596.491969:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.491987:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492000:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492025:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492032:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492039:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492045:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656596.492167:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492175:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492188:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656596.492191:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656596.492196:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.492203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656596.492679:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+37:11348:x1877639248809344:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 775us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656596.492688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:3.0:1790656596.495926:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.498830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248809600 00000100:00100000:2.0:1790656596.498844:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248809600 00000100:00100000:2.0:1790656596.498911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1790656596.498922:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+37:11348:x1877639248809600:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656596.499166:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+38:11348:x1877639248809600:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 246us (3246us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1790656596.499174:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00010000:00010000:1.0:1790656596.702765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656596.820107:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.820254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248809856 00000100:00100000:3.0:1790656596.820264:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248809856 00000100:00100000:3.0:1790656596.820330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:3.0:1790656596.820340:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+38:11379:x1877639248809856:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1790656596.820364:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656596.820384:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb57e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23793e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.820478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.820493:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.820505:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656596.820539:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790656596.820691:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb57e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23793e expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.820709:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23793e expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.820718:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656596.820721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656596.820725:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656596.820785:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+40:11379:x1877639248809856:12345-192.168.203.23@tcp:101:cat.0 Request processed in 447us (687us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790656596.820793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:3.0:1790656596.827685:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656596.827796:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.832720:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248810112 00000100:00100000:2.0:1790656596.832744:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248810112 00000100:00100000:2.0:1790656596.832823:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:2.0:1790656596.832836:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+40:11379:x1877639248810112:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1790656596.833128:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+41:11379:x1877639248810112:12345-192.168.203.23@tcp:35:cat.0 Request processed in 294us (5450us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790656596.833136:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1790656596.836656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248810240 00000100:00100000:0.0:1790656596.836672:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248810240 00000100:00100000:0.0:1790656596.836756:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656596.836767:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+41:2342:x1877639248810240:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656596.836782:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656596.836806:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23793e expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.836827:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656596.836833:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656596.838481:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+40:2342:x1877639248810240:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 131us (9098us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656596.839611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1790656596.941313:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.941412:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248810496 00000100:00100000:2.0:1790656596.941423:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248810496 00000100:00100000:2.0:1790656596.941489:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:2.0:1790656596.941499:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+40:11385:x1877639248810496:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1790656596.941532:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656596.941535:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790656596.941563:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb4eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237914 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941583:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656596.941587:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656596.941648:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb593 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237945 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941756:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941769:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941778:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941808:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656596.941835:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 40 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656596.941848:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fa82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269782016:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656596.941962:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656596.945567:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656596.945796:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fa82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269782016:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656596.945825:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656596.946322:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248810624 00000100:00100000:3.0:1790656596.946330:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248810624 00010000:00010000:3.0:1790656596.946366:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 41 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656596.946405:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1790656596.946415:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+41:2341:x1877639248810624:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656596.946429:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656596.946435:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 41 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.946463:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 41 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.946495:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237937 expref: 41 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.946519:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656596.946524:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.946533:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.946541:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656596.947057:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656596.947110:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+40:2341:x1877639248810624:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 695us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656596.947118:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00010000:00010000:0.0:1790656596.948785:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.948799:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656596.948822:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790656596.948999:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb593 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 41 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.949021:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.949029:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656596.949032:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790656596.949035:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:0.0:1790656596.949126:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+40:11385:x1877639248810496:12345-192.168.203.23@tcp:101:dd.0 Request processed in 7629us (7822us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1790656596.949135:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:3.0:1790656596.953864:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656596.954016:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248810880 00000100:00100000:1.0:1790656596.954026:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248810880 00000100:00100000:1.0:1790656596.954108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:1.0:1790656596.954119:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+40:11385:x1877639248810880:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:1.0:1790656596.954364:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.954380:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656596.954391:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790656596.954444:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1790656596.954467:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea67c8e3 reply state 00000000bd3cff98 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656596.954486:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790656596.954722:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+43:11385:x1877639248810880:12345-192.168.203.23@tcp:36:dd.0 Request processed in 604us (866us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1790656596.954729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 154 00000020:00080000:1.0:1790656596.954743:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790656596.962355:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962371:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962378:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962401:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cfe00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656596.962406:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962414:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962431:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656596.962434:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656596.962439:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656596.962446:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656597.150942:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269782144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656597.151011:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656597.151224:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782144 00000100:00100000:3.0:1790656597.151232:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782144 00000100:00100000:3.0:1790656597.151280:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790656597.151300:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269782144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656597.151323:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656597.151364:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269782144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656597.151383:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790656597.151495:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269782144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656597.152208:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269782656:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656597.152265:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790656597.152270:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269782272:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152309:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656597.152338:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782272 00000100:00100000:3.0:1790656597.152342:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782272 00000100:00100000:3.0:1790656597.152372:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1790656597.152380:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152415:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269782272:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656597.152422:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1790656597.152456:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269782272:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152480:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269782400:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656597.152521:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790656597.152526:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269782528:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.152546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656597.152883:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269782784:0@lo:400:kworker.0 00000100:00100000:1.0:1790656597.152912:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656597.153404:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782656 00000100:00100000:0.0:1790656597.153411:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782656 00000100:00100000:0.0:1790656597.153455:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790656597.153464:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269782656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790656597.153499:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656597.153523:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269782656:12345-0@lo:400:kworker.0 Request processed in 60us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656597.153529:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790656597.153544:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782400 00000100:00100000:1.0:1790656597.153548:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782400 00000100:00100000:1.0:1790656597.153569:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782528 00000100:00100000:1.0:1790656597.153572:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782528 00000100:00100000:1.0:1790656597.153586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269782784 00000100:00100000:1.0:1790656597.153589:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269782784 00000100:00100000:1.0:1790656597.153628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790656597.153634:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269782400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656597.153669:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269782400:12345-0@lo:400:kworker.0 Request processed in 35us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656597.153676:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790656597.153909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790656597.153918:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269782528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656597.153954:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269782528:12345-0@lo:400:kworker.0 Request processed in 38us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656597.153960:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790656597.153974:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790656597.153987:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269782784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656597.154023:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269782784:12345-0@lo:400:kworker.0 Request processed in 37us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656597.154029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790656597.154196:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269782656:0@lo:400:kworker.0 00000100:00080000:3.0:1790656597.154314:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656597.154334:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269782528:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.154344:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269782400:0@lo:400:kworker.0 00000100:00100000:1.0:1790656597.154367:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269782784:0@lo:400:kworker.0 00000100:00100000:3.0:1790656597.265771:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.265910:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248811008 00000100:00100000:1.0:1790656597.265920:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248811008 00000100:00100000:1.0:1790656597.266003:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 155 00000100:00100000:1.0:1790656597.266013:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+42:11399:x1877639248811008:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:1.0:1790656597.266037:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656597.266057:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23794c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266126:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266142:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266153:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266168:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266182:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266188:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266297:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266309:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 43 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266318:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266354:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 43 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.266369:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 43 pid: 6714 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656597.266383:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269782912:192.168.203.23@tcp:104: 00000100:00080000:3.0:1790656597.266573:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656597.268184:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656597.269392:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269782912:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656597.269416:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656597.270627:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656597.271303:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248811264 00000100:00100000:2.0:1790656597.271313:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248811264 00000100:00100000:2.0:1790656597.271377:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:2.0:1790656597.271387:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+44:5581:x1877639248811264:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790656597.271755:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+45:5581:x1877639248811264:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 368us (1168us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1790656597.271762:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1790656597.275117:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656597.275213:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248811392 00000100:00100000:0.0:1790656597.275222:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248811392 00010000:00010000:0.0:1790656597.275261:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 45 pid: 6714 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656597.275313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:0.0:1790656597.275323:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+45:2341:x1877639248811392:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656597.275338:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656597.275359:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 45 pid: 6714 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275373:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 45 pid: 6714 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275394:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb59a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237945 expref: 45 pid: 6714 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275409:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656597.275413:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275422:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275446:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.275522:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656597.275577:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+44:2341:x1877639248811392:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 255us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656597.275585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00010000:00010000:1.0:1790656597.280382:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280413:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656597.280462:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790656597.280587:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656597.280644:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280661:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280671:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280678:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280685:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280690:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656597.280694:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280701:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280714:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656597.280718:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656597.280722:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280739:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280756:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280762:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280767:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280772:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421ce800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656597.280775:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280780:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280788:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439148d8900) 00010000:00010000:1.0:1790656597.280790:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656597.280793:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280799:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb5bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280841:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23794c expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280856:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23794c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.280869:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:1.0:1790656597.280872:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656597.280874:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cfe00, rc 0) 00000100:00100000:1.0:1790656597.280941:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+43:11399:x1877639248811008:12345-192.168.203.23@tcp:101:stat.0 Request processed in 14927us (15177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656597.280950:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 155 00000100:00100000:3.0:1790656597.340007:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656597.340095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248811648 00000100:00100000:0.0:1790656597.340105:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248811648 00000100:00100000:0.0:1790656597.340169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:0.0:1790656597.340179:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+43:11406:x1877639248811648:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:0.0:1790656597.340235:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656597.340261:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb5c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23794c expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.340281:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656597.340297:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656597.340520:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.340533:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.340543:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656597.340641:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1790656597.340671:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ac9651 reply state 000000003ca560eb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656597.340686:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656597.340787:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+45:11406:x1877639248811648:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 610us (789us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1790656597.340794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 156 00000020:00080000:0.0:1790656597.340799:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790656597.345002:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345019:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345027:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345032:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656597.345037:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345045:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345061:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:1.0:1790656597.345064:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656597.345070:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.345075:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656597.641161:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656597.641525:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248811776 00000100:00100000:0.0:1790656597.641536:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248811776 00000100:00100000:0.0:1790656597.642320:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00100000:0.0:1790656597.642333:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+44:11420:x1877639248811776:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:0.0:1790656597.642369:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656597.642389:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb5d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237953 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642452:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642566:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642580:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642610:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642618:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642624:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642718:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642727:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642734:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656597.642767:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790656597.642771:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656597.642792:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642804:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642812:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642818:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642825:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642831:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656597.642835:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642842:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642862:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656597.642865:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656597.642870:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642876:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb5d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642890:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642895:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642901:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642906:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656597.642909:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642915:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642923:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94391836d100) 00010000:00010000:0.0:1790656597.642925:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656597.642928:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642934:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb5e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642976:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb5d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 46 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642989:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 45 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.642996:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656597.642998:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656597.643000:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507400, rc 0) 00000100:00100000:0.0:1790656597.643077:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+45:11420:x1877639248811776:12345-192.168.203.23@tcp:101:stat.0 Request processed in 747us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656597.643083:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 157 00010000:00010000:0.0:1790656597.726974:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656597.784107:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.784270:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248812032 00000100:00100000:1.0:1790656597.784280:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248812032 00000100:00100000:1.0:1790656597.784341:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:1.0:1790656597.784350:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+45:11430:x1877639248812032:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656597.784377:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656597.784396:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23795a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656597.784486:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790656597.784615:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23795a expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.784630:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:1.0:1790656597.784633:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656597.784639:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23795a expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.784653:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cec00, rc 0) 00000100:00100000:1.0:1790656597.784708:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+46:11430:x1877639248812032:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 359us (611us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1790656597.784715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:3.0:1790656597.792266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656597.793924:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248812288 00000100:00100000:2.0:1790656597.795557:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248812288 00000100:00100000:2.0:1790656597.796293:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1790656597.796307:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+46:11430:x1877639248812288:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656597.796569:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+47:11430:x1877639248812288:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 264us (4310us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1790656597.796577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1790656597.916709:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.916841:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248812544 00000100:00100000:1.0:1790656597.916850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248812544 00000100:00100000:1.0:1790656597.916914:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:1.0:1790656597.916925:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+47:11436:x1877639248812544:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656597.916947:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656597.916979:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237961 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.917077:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.917093:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.917103:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.917132:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.917146:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 48 pid: 6714 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656597.917159:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269783040:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656597.917247:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656597.928996:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.929098:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269783040:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656597.929126:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656597.938384:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248812672 00000100:00100000:3.0:1790656597.938399:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248812672 00010000:00010000:3.0:1790656597.938450:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 49 pid: 6714 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656597.938500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:3.0:1790656597.938510:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+49:2341:x1877639248812672:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656597.938524:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656597.938530:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 49 pid: 6714 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938543:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 49 pid: 6714 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938567:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb5e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237953 expref: 49 pid: 6714 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938584:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656597.938635:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938663:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938671:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656597.938707:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656597.938763:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+48:2341:x1877639248812672:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 254us (9776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656597.938770:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00010000:00010000:2.0:1790656597.939174:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.939183:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656597.939200:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790656597.939350:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb5fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.939367:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.939374:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:2.0:1790656597.939377:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790656597.939380:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce800, rc 0) 00000100:00100000:2.0:1790656597.939419:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+48:11436:x1877639248812544:12345-192.168.203.23@tcp:101:bash.0 Request processed in 22497us (22720us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1790656597.939426:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:0.0:1790656597.947797:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.948295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248812928 00000100:00100000:1.0:1790656597.948313:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248812928 00000100:00100000:1.0:1790656597.948484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:1.0:1790656597.948504:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+48:11436:x1877639248812928:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1790656597.949113:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.949134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656597.949146:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656597.949195:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1790656597.949221:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0f4fdb9 reply state 0000000022a067b0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656597.949247:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656597.949368:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+51:11436:x1877639248812928:12345-192.168.203.23@tcp:36:bash.0 Request processed in 870us (1578us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1790656597.949377:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 160 00000020:00080000:0.0:1790656597.949383:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790656597.959265:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656597.963212:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248813056 00000100:00100000:1.0:1790656597.963263:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248813056 00000100:00100000:1.0:1790656597.963403:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1790656597.963421:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+51:11436:x1877639248813056:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656597.963459:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656597.963508:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237968 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.963927:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.963944:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.963954:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.964026:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.964053:0:6714:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.964084:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.964101:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656597.964118:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269783168:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656597.964448:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790656597.965915:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.965929:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.965937:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.966106:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656597.966117:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.966131:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.966156:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:2.0:1790656597.966161:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656597.966167:0:3286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.966182:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.966191:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656597.968048:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393be14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269783168:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656597.968093:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656597.973634:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656597.973901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248813184 00000100:00100000:2.0:1790656597.973922:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248813184 00010000:00010000:2.0:1790656597.974012:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656597.974086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:2.0:1790656597.974101:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+52:2342:x1877639248813184:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656597.974125:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656597.974136:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974188:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974224:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237961 expref: 52 pid: 5845 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974250:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:2.0:1790656597.974258:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974270:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974281:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656597.974331:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656597.974509:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.974528:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656597.974633:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790656597.974638:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656597.974664:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.974779:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237968 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.974797:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237968 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656597.974805:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:1.0:1790656597.974808:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656597.974810:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cea00, rc 0) 00000100:00100000:2.0:1790656597.974946:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+51:2342:x1877639248813184:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 847us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656597.974957:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:1.0:1790656597.981453:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+50:11436:x1877639248813056:12345-192.168.203.23@tcp:101:bash.0 Request processed in 15102us (19268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656597.981481:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:3.0:1790656597.993799:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656597.993953:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248813440 00000100:00100000:0.0:1790656597.993974:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248813440 00000100:00100000:0.0:1790656597.994041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1790656597.994054:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+50:11436:x1877639248813440:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:0.0:1790656597.994461:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+51:11436:x1877639248813440:12345-192.168.203.23@tcp:35:bash.0 Request processed in 403us (673us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790656597.994478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1790656598.189704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656598.191332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248813696 00000100:00100000:2.0:1790656598.191358:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248813696 00000100:00100000:2.0:1790656598.191442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1790656598.191454:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+51:11446:x1877639248813696:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656598.191487:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656598.191513:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23796f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656598.191822:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790656598.193117:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb626 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23796f expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.193140:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:2.0:1790656598.193144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656598.193150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23796f expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.193169:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481e00, rc 0) 00000100:00100000:2.0:1790656598.193329:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:11446:x1877639248813696:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1876us (3637us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1790656598.193340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:3.0:1790656598.206303:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.206689:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248813824 00000100:00100000:0.0:1790656598.206701:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248813824 00000100:00100000:0.0:1790656598.206777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:0.0:1790656598.206790:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+52:11446:x1877639248813824:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1790656598.206888:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207141:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207156:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207177:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207201:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207208:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207330:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207341:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207349:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656598.207411:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207426:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207434:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207442:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207450:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656598.207454:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207475:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207498:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656598.207502:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656598.207508:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207539:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207546:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207551:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207556:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656598.207559:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207574:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.207581:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94391836d100) 00010000:00010000:0.0:1790656598.207584:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656598.207587:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209380:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb63b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209438:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209458:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209466:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209473:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656598.209478:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209486:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209502:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656598.209506:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656598.209511:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.209517:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656598.209664:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+52:11446:x1877639248813824:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 2871us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656598.209675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1790656598.213436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.213529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248814080 00000100:00100000:0.0:1790656598.213542:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248814080 00000100:00100000:0.0:1790656598.213652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1790656598.213682:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+52:11446:x1877639248814080:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1790656598.214147:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+53:11446:x1877639248814080:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 465us (723us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1790656598.214157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:1.0:1790656598.327091:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656598.327237:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248814336 00000100:00100000:3.0:1790656598.327250:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248814336 00000100:00100000:3.0:1790656598.327331:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:3.0:1790656598.327345:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+53:11449:x1877639248814336:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656598.327667:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656598.327698:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237976 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.327804:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328649:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328688:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328711:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328720:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328726:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.328885:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb65e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330068:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330096:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656598.330114:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790656598.330275:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330296:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330305:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330312:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656598.330330:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330339:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330355:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656598.330359:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656598.330365:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330372:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330401:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330408:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330415:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330421:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656598.330424:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330431:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330439:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3400) 00010000:00010000:3.0:1790656598.330442:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656598.330451:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330458:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330537:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237976 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.330554:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb65e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237976 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.331730:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656598.331735:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656598.331739:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656598.332314:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+55:11449:x1877639248814336:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4966us (5231us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1790656598.332326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:3.0:1790656598.343755:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656598.343882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.344167:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248814592 00000100:00100000:0.0:1790656598.344183:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248814592 00000100:00100000:0.0:1790656598.344374:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1790656598.344409:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+55:2341:x1877639248814592:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656598.344434:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656598.344827:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb65e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237976 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.344852:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:0.0:1790656598.344859:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656598.344944:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+54:2341:x1877639248814592:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 543us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656598.344953:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1790656598.345976:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248814464 00000100:00100000:1.0:1790656598.345991:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248814464 00000100:00100000:1.0:1790656598.346062:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1790656598.346073:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:11449:x1877639248814464:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1790656598.346154:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346173:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346187:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346219:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346227:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346237:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346246:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cf800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656598.346252:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346263:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346289:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:1.0:1790656598.346296:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656598.346326:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.346336:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656598.346446:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:11449:x1877639248814464:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 373us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656598.346457:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:3.0:1790656598.351018:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656598.351259:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248814848 00000100:00100000:1.0:1790656598.351276:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248814848 00000100:00100000:1.0:1790656598.351394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1790656598.351410:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+54:11449:x1877639248814848:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656598.351940:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+55:11449:x1877639248814848:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 533us (935us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1790656598.351949:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1790656598.630200:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656598.630441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248815104 00000100:00100000:2.0:1790656598.630457:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248815104 00000100:00100000:2.0:1790656598.630548:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:2.0:1790656598.630569:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+55:11467:x1877639248815104:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1790656598.630649:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656598.630676:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23797d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.630809:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb67a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.630827:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb67a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.630862:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb67a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656598.630879:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790656598.631424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23797d expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.631444:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb67a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23797d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656598.631454:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:2.0:1790656598.631457:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790656598.631461:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481200, rc 0) 00000100:00100000:2.0:1790656598.631545:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:11467:x1877639248815104:12345-192.168.203.23@tcp:101:cat.0 Request processed in 987us (1359us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790656598.631553:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:3.0:1790656598.676666:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656598.676839:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248815232 00000100:00100000:1.0:1790656598.676853:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248815232 00000100:00100000:1.0:1790656598.676932:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:1.0:1790656598.676944:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+57:11468:x1877639248815232:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656598.676984:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656598.677010:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237984 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677092:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677107:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677136:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656598.677178:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790656598.677182:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656598.677201:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677230:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237984 expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677252:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237984 expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656598.677261:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656598.677264:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656598.677267:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421ce000, rc 0) 00000100:00100000:1.0:1790656598.677358:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+58:11468:x1877639248815232:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 416us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656598.677366:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:3.0:1790656598.682537:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656598.682727:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248815616 00000100:00100000:1.0:1790656598.682740:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248815616 00000100:00100000:1.0:1790656598.682807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1790656598.682819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+58:11468:x1877639248815616:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656598.684731:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+59:11468:x1877639248815616:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 761us (1064us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790656598.684750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1790656598.686857:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269783296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656598.686958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656598.687225:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269783296 00000100:00100000:3.0:1790656598.687236:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269783296 00000100:00100000:3.0:1790656598.687307:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790656598.687319:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269783296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656598.687363:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656598.687425:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269783296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656598.687449:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790656598.687584:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269783296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656598.687806:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656598.687871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248815744 00000100:00100000:3.0:1790656598.687876:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248815744 00000100:00100000:3.0:1790656598.688065:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1790656598.688074:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+59:11468:x1877639248815744:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1790656598.688087:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790656598.688117:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb61f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237968 expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.688147:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb67a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23797d expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.688165:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb52a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237929 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.688180:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3100) 00010000:00010000:3.0:1790656598.688196:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656598.688271:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+56:11468:x1877639248815744:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 195us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656598.688290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1790656598.695416:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656598.695508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248815872 00000100:00100000:3.0:1790656598.695521:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248815872 00000100:00100000:3.0:1790656598.695697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:3.0:1790656598.695710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:11468:x1877639248815872:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:3.0:1790656598.695847:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.695888:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656598.695912:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790656598.696164:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790656598.696300:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:11468:x1877639248815872:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 589us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656598.696312:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 168 00010000:00010000:1.0:1790656598.750810:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656598.755552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.755818:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816000 00000100:00100000:0.0:1790656598.755836:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816000 00000100:00100000:0.0:1790656598.755919:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:0.0:1790656598.755930:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:11470:x1877639248816000:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656598.755976:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656598.756003:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb69d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a23798b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756092:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756109:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756122:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756139:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756145:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756152:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756296:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756309:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756318:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656598.756372:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790656598.756390:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656598.756428:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756446:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756459:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756467:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756475:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756481:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656598.756486:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756494:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756508:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656598.756511:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656598.756516:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756524:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb6a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756543:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756564:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756570:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756575:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656598.756578:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756584:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756851:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94391836d100) 00010000:00010000:0.0:1790656598.756855:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656598.756858:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756865:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507000/0x9c3a6e82066eb6ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756906:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507e00/0x9c3a6e82066eb69d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756921:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656598.756928:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:0.0:1790656598.756931:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656598.756939:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507200, rc 0) 00000100:00100000:0.0:1790656598.757062:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+57:11470:x1877639248816000:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1133us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656598.757070:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:0.0:1790656598.797970:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.798018:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.798051:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.798085:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656598.798121:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816256 00000100:00100000:0.0:1790656598.798132:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816256 00000100:00100000:0.0:1790656598.798196:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816384 00000100:00100000:0.0:1790656598.798198:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816384 00000100:00100000:0.0:1790656598.798219:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1790656598.798229:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248816256:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656598.798321:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248816256:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656598.798329:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1790656598.798347:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1790656598.798352:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248816384:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656598.798372:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248816384:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 20us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656598.798378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:2.0:1790656598.798562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816512 00000100:00100000:2.0:1790656598.798567:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816512 00000100:00100000:2.0:1790656598.798649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:2.0:1790656598.798657:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248816512:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656598.798693:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248816512:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656598.798699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00080000:3.0:1790656598.799138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656598.799144:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656598.799146:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656598.799253:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816128 00000100:00100000:1.0:1790656598.799259:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816128 00000100:00100000:1.0:1790656598.799349:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 289 00000100:00100000:1.0:1790656598.799357:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248816128:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656598.799400:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248816128:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656598.799407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 289 00000040:00080000:1.0:1790656599.646926:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656599.646938:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656599.647007:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1790656599.647016:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790656599.647305:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269783424:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790656599.647437:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790656599.661146:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.661346:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439281b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269783424:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790656599.668526:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816640 00000100:00100000:3.0:1790656599.668548:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816640 00000100:00100000:3.0:1790656599.668873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:3.0:1790656599.668887:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:11481:x1877639248816640:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790656599.668927:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790656599.669189:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:11481:x1877639248816640:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 305us (8057us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656599.669198:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00080000:2.0:1790656599.672229:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656599.685324:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656599.685663:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248816768 00000100:00100000:2.0:1790656599.685677:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248816768 00000100:00100000:2.0:1790656599.685756:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:2.0:1790656599.685795:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390a398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:11481:x1877639248816768:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790656599.685903:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.685924:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.685939:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688255:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688313:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688369:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688382:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688393:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656599.688475:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790656599.688480:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656599.688506:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688551:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688558:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688565:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688580:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656599.688586:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688623:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688640:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:2.0:1790656599.688643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656599.688649:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688655:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb6b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688673:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688679:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688684:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688696:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656599.688699:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688706:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688714:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff943909b4ad00) 00010000:00010000:2.0:1790656599.688716:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656599.688719:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688726:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb6c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688744:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688751:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688757:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688764:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656599.688767:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.688775:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.689875:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:2.0:1790656599.689881:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656599.689888:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.690018:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb6c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656599.693433:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390a398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+57:11481:x1877639248816768:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 7628us (8106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656599.699130:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1790656599.700297:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.700379:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248817024 00000100:00100000:1.0:1790656599.700391:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248817024 00000100:00100000:1.0:1790656599.700536:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:1.0:1790656599.700548:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:11481:x1877639248817024:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.700580:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656599.700631:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb6ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237992 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700749:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700787:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700810:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656599.700825:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790656599.700939:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700947:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700965:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700972:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cea00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656599.700977:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700985:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.700999:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:1.0:1790656599.701002:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656599.701008:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.701014:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cea00/0x9c3a6e82066eb6d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.701061:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb6ce lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237992 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.701077:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:1.0:1790656599.701079:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656599.701083:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf800/0x9c3a6e82066eb6ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237992 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.701094:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cf800, rc 0) 00000100:00100000:1.0:1790656599.701163:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817024:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 617us (872us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1790656599.701171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:1.0:1790656599.714335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.714377:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248817152 00000100:00100000:1.0:1790656599.714389:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248817152 00000100:00100000:1.0:1790656599.714470:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1790656599.714482:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817152:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790656599.714554:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790656599.716059:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817152:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 1572us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.716071:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1790656599.720187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.720241:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248817408 00000100:00100000:1.0:1790656599.720253:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248817408 00000100:00100000:1.0:1790656599.720326:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:1.0:1790656599.720339:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.720366:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656599.720377:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790656599.720411:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce000/0x9c3a6e82066eb68f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237984 expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.720436:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656599.720442:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656599.720462:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb6e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237999 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790656599.722864:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1790656599.726258:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb6ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.726297:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.726313:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.726406:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421ce800/0x9c3a6e82066eb6e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237999 expref: 60 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.726429:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb6ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237999 expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.726439:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8800) 00010000:00010000:1.0:1790656599.726442:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656599.726447:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9439421cec00, rc 0) 00000100:00100000:1.0:1790656599.726554:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+59:11481:x1877639248817408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 6216us (6379us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1790656599.726604:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:1.0:1790656599.733285:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.733342:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248817664 00000100:00100000:1.0:1790656599.733358:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248817664 00000100:00100000:1.0:1790656599.733442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:1.0:1790656599.733460:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+59:11481:x1877639248817664:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.735049:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656599.735104:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cec00/0x9c3a6e82066eb6ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237999 expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735136:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8800) 00010000:00010000:1.0:1790656599.735155:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656599.735191:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735211:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735226:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735253:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735263:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735282:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735584:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735616:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735622:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735628:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439421cfe00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656599.735632:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735640:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735648:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656599.735652:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656599.735656:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735661:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cfe00/0x9c3a6e82066eb6f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735679:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735685:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735696:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148c800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656599.735699:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735704:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735713:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2dcf2be8 (ffff9439148d8900) 00010000:00010000:1.0:1790656599.735715:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656599.735718:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.735724:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c800/0x9c3a6e82066eb6ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2dcf2be8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656599.735837:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817664:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2381us (2574us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656599.735848:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:1.0:1790656599.744200:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.744241:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248817792 00000100:00100000:1.0:1790656599.744255:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248817792 00000100:00100000:1.0:1790656599.744381:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:1.0:1790656599.744397:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+58:11481:x1877639248817792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.744429:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656599.744462:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c200/0x9c3a6e82066eb706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379a0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744716:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744743:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744756:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744869:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94390148c200/0x9c3a6e82066eb706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 60 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744891:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.744900:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:1.0:1790656599.744903:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790656599.744907:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94390148d800, rc 0) 00000100:00100000:1.0:1790656599.746162:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+59:11481:x1877639248817792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1761us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.746173:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:1.0:1790656599.752357:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656599.753696:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818048 00000100:00100000:0.0:1790656599.753712:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818048 00000100:00100000:0.0:1790656599.753781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:0.0:1790656599.753799:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+59:11481:x1877639248818048:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790656599.753910:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.753933:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.753968:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656599.754334:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1790656599.754345:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314890752948ns, next at 315890750185ns, rc = 0 00000004:00010000:0.0:1790656599.754456:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073613106 reply state 000000005bf48a98 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656599.754467:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656599.755204:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+61:11481:x1877639248818048:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 1401us (2856us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1790656599.755215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 177 00010000:00010000:2.0:1790656599.776648:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776675:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776685:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776693:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656599.776698:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776709:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776731:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656599.776734:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790656599.776740:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.776747:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb714 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.779321:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656599.784753:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.787795:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818176 00000100:00100000:1.0:1790656599.787815:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818176 00000100:00100000:1.0:1790656599.787889:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:1.0:1790656599.787900:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+60:11481:x1877639248818176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.787931:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656599.787970:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379a7 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.788060:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 61 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.788077:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 61 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.788099:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:1.0:1790656599.788102:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656599.788107:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07200, rc 0) 00000100:00100000:1.0:1790656599.788184:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:11481:x1877639248818176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 285us (3449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.788191:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:2.0:1790656599.802304:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656599.802361:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818304 00000100:00100000:2.0:1790656599.802374:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818304 00000100:00100000:2.0:1790656599.802446:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1790656599.802461:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248818304:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790656599.806327:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248818304:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 3850us (4017us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790656599.806348:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:1.0:1790656599.812228:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.812285:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818560 00000100:00100000:1.0:1790656599.812295:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818560 00000100:00100000:1.0:1790656599.812352:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1790656599.812368:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+61:11481:x1877639248818560:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790656599.812686:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+62:11481:x1877639248818560:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 324us (468us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1790656599.812694:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1790656599.830067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.830191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818816 00000100:00100000:1.0:1790656599.830206:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818816 00000100:00100000:1.0:1790656599.830278:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 179 00000100:00100000:1.0:1790656599.830292:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+62:11481:x1877639248818816:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790656599.830418:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+62:11481:x1877639248818816:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 128us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.830445:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 179 00000001:00080000:0.0:1790656599.830652:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000020:00080000:0.0:1790656599.830692:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943909b54600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790656599.830698:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943908e37780 00000020:00080000:0.0:1790656599.830702:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943902c04000 00000001:00080000:0.0:1790656599.830735:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:0.0:1790656599.830797:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790656599.830808:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1790656599.830987:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94380324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269783552:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1790656599.831054:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790656599.831068:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656599.831232:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269783552 00000100:00100000:1.0:1790656599.831240:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269783552 00000100:00100000:1.0:1790656599.831306:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790656599.831315:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1877639269783552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790656599.831336:0:8825:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1790656599.831368:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abb4053, atime: 0x6abb4053, ctime: 0x6abb4053, blocks: 0x1 00010000:00010000:1.0:1790656599.831376:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.831394:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=314s v=(0 0) 00000100:00080000:0.0:1790656599.831396:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790656599.831400:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656599.831409:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.831424:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.831433:0:8825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.831442:0:8825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.831480:0:8825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656599.831723:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656599.831733:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.831746:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656599.831751:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.831762:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.831785:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.831793:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f299bac3/0x9c3a6e82066eb722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.831816:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656599.831819:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656599.831820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656599.833515:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1877639269783552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2195us (2443us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790656599.833526:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:0.0:1790656599.833792:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94380324b100/2, rc 0, transno 4294967307 00000100:00100000:0.0:1790656599.833807:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94380324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269783552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790656599.845079:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656599.845213:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248818944 00000100:00100000:0.0:1790656599.845227:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248818944 00000100:00100000:0.0:1790656599.845316:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:0.0:1790656599.845340:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+20:11481:x1877639248818944:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656599.845369:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656599.845398:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379ae expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845532:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845549:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845563:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656599.845637:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656599.845664:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845700:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ae expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845723:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ae expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.845734:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:0.0:1790656599.845737:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790656599.845742:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506e00, rc 0) 00000100:00100000:0.0:1790656599.845816:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+21:11481:x1877639248818944:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 479us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656599.845835:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:3.0:1790656599.857779:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.857850:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819072 00000100:00100000:1.0:1790656599.857864:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819072 00000100:00100000:1.0:1790656599.857935:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1790656599.857961:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248819072:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656599.857980:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656599.858002:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379b5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656599.858030:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abb4056, blocks: 0x1 00010000:00010000:1.0:1790656599.858061:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1790656599.858066:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656599.858076:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.858092:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.858105:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06c00, rc 0) 00000100:00100000:1.0:1790656599.858170:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248819072:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.858194:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:0.0:1790656599.881506:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656599.885105:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819328 00000100:00100000:2.0:1790656599.885128:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819328 00000100:00100000:2.0:1790656599.885282:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:2.0:1790656599.885300:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+21:11481:x1877639248819328:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790656599.885453:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+21:11481:x1877639248819328:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 159us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656599.885463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:3.0:1790656599.909106:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656599.909650:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819456 00000100:00100000:0.0:1790656599.909664:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819456 00000100:00100000:0.0:1790656599.909737:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1790656599.909750:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+8:11481:x1877639248819456:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656599.909774:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656599.909798:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379bc expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.909837:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.910026:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790656599.910034:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656599.910044:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.910099:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656599.910121:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656599.910141:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943803248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269783680:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656599.910747:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2240 going to sleep for 11 seconds 00000100:00100000:3.0:1790656599.927510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656599.928421:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943803248a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269783680:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656599.928477:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656599.928504:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507800, rc 0) 00000100:00100000:1.0:1790656599.929651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+9:11481:x1877639248819456:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 19898us (20552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656599.929663:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:2.0:1790656599.929866:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819584 00000100:00100000:2.0:1790656599.929876:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819584 00010000:00010000:2.0:1790656599.929918:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656599.929968:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1790656599.929977:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248819584:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656599.929994:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656599.930021:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.930043:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.930076:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000246eb3f1/0x9c3a6e82066eb737 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379b5 expref: 9 pid: 6692 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.930091:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656599.930096:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656599.930106:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.930117:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656599.930163:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656599.930185:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877639269783808:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656599.930255:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790656599.946870:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877639269783808:192.168.203.23@tcp:105: 00010000:00010000:3.0:1790656599.946906:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656599.947094:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248819584:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 17116us (20149us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656599.947109:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1790656599.958852:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656599.960419:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819712 00000100:00100000:3.0:1790656599.960438:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819712 00002000:00100000:0.0:1790656599.967201:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff943803248700 x1877639248819712/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:460/0 lens 504/0 e 0 to 0 dl 1790656610 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656599.967221:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943803248700 with x1877639248819712 ext(0->8) 00002000:00010000:0.0:1790656599.967230:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff943803248700 00000100:00100000:0.0:1790656599.967335:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1790656599.967349:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248819712:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790656599.969310:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803248700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+10:2342:x1877639248819712:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 1951us (10461us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790656599.969326:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00002000:00100000:0.0:1790656599.969345:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff943803248700 x1877639248819712/t4294967314(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:460/0 lens 504/448 e 0 to 0 dl 1790656610 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656599.969358:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943803248700 with x1877639248819712 ext(0->8) 00002000:00010000:0.0:1790656599.969367:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff943803248700 00000040:00080000:3.0:1790656599.981234:0:12406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790656599.981248:0:12406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790656599.981321:0:12406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1790656599.981327:0:12406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790656599.982820:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656599.987407:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819840 00000100:00100000:0.0:1790656599.987431:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819840 00000100:00100000:0.0:1790656599.987527:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1790656599.987540:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+21:11481:x1877639248819840:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790656600.111121:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1790656600.111138:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1790656600.111163:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1790656600.111191:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1790656600.111350:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1790656600.111370:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790656600.111393:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269783936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790656600.112134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656600.113281:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+18:11481:x1877639248819840:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 125726us (130459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656600.113296:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:1.0:1790656600.119885:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269783936 00000100:00100000:1.0:1790656600.119904:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269783936 00000100:00080000:2.0:1790656600.121141:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656600.121575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790656600.121612:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269783936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790656600.121901:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790656600.121908:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790656599 00002000:00010000:1.0:1790656600.121911:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790656600.121914:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790656598 -> 1790656599 00002000:00010000:1.0:1790656600.121916:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790656600.122302:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269783936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 714us (10172us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790656600.122311:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1790656600.122491:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94390977d880/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790656600.122500:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94390977d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269783936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790656600.125826:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656600.126976:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248819968 00000100:00100000:0.0:1790656600.126990:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248819968 00000100:00100000:0.0:1790656600.127107:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:0.0:1790656600.127119:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+10:2341:x1877639248819968:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1790656600.127281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790656600.357868:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1790656600.357897:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1790656600.358246:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248819968:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 231121us (232426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656600.358290:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1790656600.380472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656600.381627:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820224 00000100:00100000:2.0:1790656600.381642:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820224 00000100:00100000:2.0:1790656600.381714:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:2.0:1790656600.381726:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+18:11481:x1877639248820224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790656600.381795:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656600.381834:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ae expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.381857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656600.381864:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656600.381902:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.381918:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.382935:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656600.383319:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000821c9556 reply state 0000000094af1283 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.383333:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656600.383529:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+19:11481:x1877639248820224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 1799us (3067us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1790656600.383543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 183 00010000:00010000:2.0:1790656600.386902:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.386925:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.386933:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.386940:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656600.386954:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.386964:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.386984:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656600.386988:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656600.386994:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.387023:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.390317:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656600.390720:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820352 00000100:00100000:3.0:1790656600.390734:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820352 00000100:00100000:3.0:1790656600.390795:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1790656600.390806:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248820352:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790656600.391136:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790656600.391140:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790656599 -> 1790656597 00002000:00010000:3.0:1790656600.391143:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790656595 00002000:00010000:3.0:1790656600.391146:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790656599 -> 1790656597 00002000:00010000:3.0:1790656600.391148:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790656600.391231:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248820352:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 424us (931us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790656600.391239:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:2.0:1790656600.394230:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656600.394516:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820608 00000100:00100000:3.0:1790656600.394540:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820608 00000100:00100000:2.0:1790656600.394924:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:2.0:1790656600.394942:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+18:11481:x1877639248820608:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790656600.395068:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.395093:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.395106:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.395179:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.395196:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 18 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.395211:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269784064:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656600.395339:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656600.405716:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656600.405755:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820736 00000100:00100000:2.0:1790656600.405767:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820736 00010000:00010000:2.0:1790656600.405828:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.405878:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1790656600.405888:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+19:2341:x1877639248820736:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656600.405906:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656600.405914:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.405929:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.405956:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656600.405963:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.405975:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.405984:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406009:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656600.406071:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+19:2341:x1877639248820736:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 183us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656600.406079:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00010000:00010000:2.0:1790656600.406241:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94390148d800/0x9c3a6e82066eb70d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a0 expref: 18 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.406282:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269784064:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656600.406306:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406316:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406323:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406358:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406367:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406374:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406382:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656600.406387:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406395:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406405:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656600.406408:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790656600.406413:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.406426:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb74c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.406479:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+17:11481:x1877639248820608:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 11543us (12260us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790656600.406914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 184 00000001:00080000:0.0:1790656600.412475:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1790656600.412515:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1790656600.427348:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656600.427435:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820864 00000100:00100000:1.0:1790656600.427459:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820864 00000100:00100000:1.0:1790656600.427527:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1790656600.427539:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+8:2340:x1877639248820864:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790656600.427648:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.427672:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.427681:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656600.427687:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656600.427691:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.427735:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.427751:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656600.427768:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269784192:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656600.427864:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390394b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656600.445093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656600.445253:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248820992 00000100:00100000:3.0:1790656600.445274:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248820992 00010000:00010000:3.0:1790656600.445328:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 9 pid: 6691 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656600.445377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1790656600.445388:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248820992:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656600.445407:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656600.445434:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 9 pid: 6691 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656600.445460:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 9 pid: 6691 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656600.445501:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656600.445506:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656600.445513:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656600.445526:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656600.445556:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656600.445680:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248820992:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 293us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656600.445688:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00010000:00010000:1.0:1790656600.446514:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cde409d0/0x9c3a6e82066eb73e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379bc expref: 8 pid: 6691 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656600.446537:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1877639269784192:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656600.446565:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446650:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446659:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446695:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446705:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446715:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446723:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656600.446727:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446738:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446755:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.446775:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656600.446846:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2340:x1877639248820864:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 19309us (19511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656600.446856:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1790656600.467772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656600.467890:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248821248 00000100:00100000:0.0:1790656600.467904:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248821248 00000100:00100000:0.0:1790656600.467985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:0.0:1790656600.467997:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+17:11481:x1877639248821248:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790656600.468098:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468120:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468133:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468413:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468426:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468435:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468784:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.468803:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 18 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656600.468834:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94380324aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269784320:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656600.468939:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790656600.478894:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656600.479152:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94380324aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269784320:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656600.479188:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656600.480062:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248821376 00000100:00100000:1.0:1790656600.480075:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248821376 00010000:00010000:1.0:1790656600.480127:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656600.480173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:1.0:1790656600.480184:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+19:2341:x1877639248821376:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656600.480203:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656600.480211:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480225:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480254:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb71b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379a7 expref: 19 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480282:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:1.0:1790656600.480287:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480315:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480323:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656600.480356:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656600.480434:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+18:2341:x1877639248821376:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 251us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656600.480442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00010000:00010000:2.0:1790656600.480738:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.480747:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656600.480989:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1790656600.481156:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1790656600.481203:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1790656600.481309:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269784448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790656600.481380:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656600.481420:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790656600.482381:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269784448 00000100:00100000:1.0:1790656600.482393:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269784448 00000100:00100000:1.0:1790656600.482461:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790656600.482471:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269784448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790656600.482734:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269784448:12345-0@lo:1000:mdt00_000.0 Request processed in 263us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656600.482744:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656600.483177:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790656600.483184:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94390977d880, transno 4294967315 00000100:00100000:2.0:1790656600.483205:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269784448:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790656600.484358:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790656600.484443:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269784576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790656600.486200:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656600.486251:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656600.486364:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269784576 00000100:00100000:1.0:1790656600.486376:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269784576 00000100:00100000:1.0:1790656600.486454:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790656600.486466:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269784576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790656600.487775:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1877639269784576:12345-0@lo:1000:mdt00_000.0 Request processed in 1305us (1576us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790656600.487787:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656600.489309:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269784576:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790656600.489377:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489390:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489399:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489406:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656600.489412:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489423:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489867:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9439148d8000) 00010000:00010000:2.0:1790656600.489873:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656600.489881:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb761 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489940:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489975:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489981:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489987:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656600.489991:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.489998:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:2.0:1790656600.490011:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656600.490014:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490021:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb696 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490065:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490075:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490121:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.490146:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 21 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.490164:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269784704:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656600.490289:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928554240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656600.495010:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269784704:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656600.495049:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656600.504320:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656600.504673:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248821504 00000100:00100000:2.0:1790656600.504686:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248821504 00010000:00010000:2.0:1790656600.504740:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 22 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656600.504848:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:2.0:1790656600.504860:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+22:2341:x1877639248821504:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656600.504879:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656600.504887:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 22 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.504916:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 22 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.504954:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb6b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a23798b expref: 22 pid: 6714 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.504997:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:2.0:1790656600.505004:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.505015:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.505024:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.505060:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656600.505135:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+21:2341:x1877639248821504:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 276us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656600.505144:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00010000:00010000:0.0:1790656600.505977:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.505994:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506014:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506024:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506033:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506042:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656600.506049:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506060:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506078:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:0.0:1790656600.506084:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656600.506090:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506119:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481000/0x9c3a6e82066eb768 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506142:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506151:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506158:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506164:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656600.506168:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506188:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3400) 00010000:00010000:0.0:1790656600.506207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656600.506212:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.506220:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb75a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656600.510211:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+20:11481:x1877639248821248:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 42196us (42434us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1790656600.510234:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 185 00000020:00080000:0.0:1790656600.510280:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790656600.510903:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656600.510909:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656600.511396:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790656600.511414:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790656600.525501:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656600.525629:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248821760 00000100:00100000:2.0:1790656600.525643:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248821760 00000100:00100000:2.0:1790656600.525741:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1790656600.525757:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+20:11481:x1877639248821760:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790656600.526781:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790656600.526950:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1790656600.527005:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527028:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527045:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527077:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527087:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527096:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656600.527116:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790656600.527290:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+22:11481:x1877639248821760:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1531us (1795us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1790656600.527305:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000020:00080000:2.0:1790656600.527314:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790656600.527635:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656600.527648:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.527659:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656600.527664:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.527675:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.527696:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff943909b4ae00) 00010000:00010000:0.0:1790656600.527700:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790656600.527707:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.527715:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066eb76f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656600.527743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656600.527746:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656600.527748:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656600.801726:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656601.828190:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656602.271084:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269784832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656602.271196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656602.271320:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269784832 00000100:00100000:2.0:1790656602.271329:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269784832 00000100:00100000:2.0:1790656602.271399:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790656602.271409:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269784832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656602.271458:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656602.271526:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269784832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656602.271537:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1790656602.271566:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656602.271624:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1790656602.271631:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1790656602.271667:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94380324b100, transno 4294967307 00000100:00100000:2.0:1790656602.271690:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269784832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656602.272184:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269784960:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.272249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656602.272307:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269785472:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.272338:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656602.272371:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656602.272380:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269785088:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.272435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656602.272860:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269784960 00000100:00100000:1.0:1790656602.272868:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269784960 00000100:00100000:1.0:1790656602.272925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790656602.272937:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269784960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656602.272992:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269784960:12345-0@lo:400:kworker.0 Request processed in 57us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.273003:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790656602.273294:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269784960:0@lo:400:kworker.0 00000100:00100000:2.0:1790656602.274658:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269785472 00000100:00100000:2.0:1790656602.274671:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269785472 00000100:00100000:2.0:1790656602.274801:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269785088 00000100:00100000:2.0:1790656602.274806:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269785088 00000100:00080000:0.0:1790656602.275388:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656602.276841:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269785216:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.276941:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656602.277420:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656602.277430:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269785344:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.277473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656602.277615:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269785216 00000100:00100000:1.0:1790656602.277625:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269785216 00000100:00100000:1.0:1790656602.277691:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790656602.277703:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269785472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656602.277770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269785472:12345-0@lo:400:kworker.0 Request processed in 70us (5432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.277778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790656602.277805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790656602.277812:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269785088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656602.277842:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269785088:12345-0@lo:400:kworker.0 Request processed in 30us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.277847:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790656602.277860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790656602.277865:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269785216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656602.277895:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269785216:12345-0@lo:400:kworker.0 Request processed in 30us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.277901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1790656602.279440:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656602.279521:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269785216:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.279571:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269785088:0@lo:400:kworker.0 00000100:00100000:0.0:1790656602.279584:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269785472:0@lo:400:kworker.0 00000100:00100000:3.0:1790656602.289677:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269785344 00000100:00100000:3.0:1790656602.289696:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269785344 00000100:00080000:0.0:1790656602.289796:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656602.298909:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790656602.298943:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656602.299081:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877639269785344:12345-0@lo:400:kworker.0 Request processed in 149us (21604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.300048:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269785344:0@lo:400:kworker.0 00000100:00100000:3.0:1790656602.300277:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000040:00080000:2.0:1790656602.485310:0:12459:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790656602.485325:0:12459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790656602.485403:0:12459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790656602.485412:0:12459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790656602.654711:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.654753:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248822016 00000100:00100000:3.0:1790656602.654765:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248822016 00000100:00100000:3.0:1790656602.654838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:3.0:1790656602.654862:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+22:11499:x1877639248822016:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656602.654896:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656602.654924:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379c3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.655043:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb77d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.655060:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb77d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.655077:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb77d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656602.655089:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000100:00080000:2.0:1790656602.655878:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790656602.656212:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379c3 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.656273:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb77d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379c3 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.656285:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656602.656289:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790656602.656293:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96a00, rc 0) 00000100:00100000:3.0:1790656602.656386:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+24:11499:x1877639248822016:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1525us (1683us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1790656602.656397:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:3.0:1790656602.658091:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656602.658166:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248822144 00000100:00100000:2.0:1790656602.658178:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248822144 00000100:00100000:2.0:1790656602.658275:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:2.0:1790656602.658288:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+24:11499:x1877639248822144:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1790656602.658382:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658404:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658418:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658525:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658535:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658544:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658916:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658927:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.658934:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656602.658987:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659002:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659009:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659017:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659023:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656602.659029:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659038:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659053:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656602.659057:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656602.659063:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659078:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb78b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659098:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659103:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659109:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659114:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656602.659117:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659123:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659133:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943909b4ad00) 00010000:00010000:2.0:1790656602.659136:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656602.659140:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659146:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659164:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659171:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659184:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659190:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656602.659193:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659199:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659207:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4ab00) 00010000:00010000:2.0:1790656602.659209:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656602.659212:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.659218:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656602.659347:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+24:11499:x1877639248822144:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1058us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656602.659358:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:0.0:1790656602.727960:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.728081:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248822400 00000100:00100000:3.0:1790656602.728095:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248822400 00000100:00100000:3.0:1790656602.728171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:3.0:1790656602.728184:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+24:11502:x1877639248822400:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656602.728212:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656602.728238:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379ca expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728357:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728373:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728424:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728432:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728439:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728851:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728856:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656602.728864:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790656602.728969:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728977:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728984:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.728991:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.728997:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729016:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729031:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656602.729035:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.729041:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729048:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729061:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729067:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729074:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729079:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.729082:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729088:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3100) 00010000:00010000:3.0:1790656602.729098:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.729100:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729123:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729169:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729180:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.729185:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656602.729187:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656602.729188:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96200, rc 0) 00000100:00100000:3.0:1790656602.729263:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+26:11502:x1877639248822400:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1082us (1316us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790656602.729270:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:3.0:1790656602.732498:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656602.732699:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248822528 00000100:00100000:0.0:1790656602.732713:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248822528 00000100:00100000:2.0:1790656602.732864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:2.0:1790656602.732877:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+26:11502:x1877639248822528:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1790656602.732979:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.732999:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733036:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733069:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733076:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733082:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733088:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656602.733092:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733100:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733113:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:2.0:1790656602.733116:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656602.733122:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.733128:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656602.733218:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+26:11502:x1877639248822528:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 342us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656602.733226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:0.0:1790656602.736717:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656602.736813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248822784 00000100:00100000:1.0:1790656602.736826:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248822784 00000100:00100000:1.0:1790656602.736900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1790656602.736912:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+26:11502:x1877639248822784:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656602.737222:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+27:11502:x1877639248822784:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 311us (517us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790656602.737229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:0.0:1790656602.781229:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.781352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823040 00000100:00100000:3.0:1790656602.781367:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823040 00000100:00100000:3.0:1790656602.781448:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:3.0:1790656602.781460:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+27:11029:x1877639248823040:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656602.781492:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656602.781517:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.781704:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.781744:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.781755:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.781797:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.781814:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 28 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656602.781831:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935267800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269785600:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656602.782152:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656602.785891:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935267800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269785600:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656602.785952:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656602.786554:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.786871:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823168 00000100:00100000:3.0:1790656602.786881:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823168 00010000:00010000:3.0:1790656602.787044:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 29 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656602.787091:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:3.0:1790656602.787103:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+29:2341:x1877639248823168:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656602.787121:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656602.787147:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 29 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787161:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 29 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787188:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ca expref: 29 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787208:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656602.787215:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787226:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787236:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.787408:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656602.787564:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+28:2341:x1877639248823168:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 462us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656602.787573:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00010000:00010000:0.0:1790656602.787876:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656602.787887:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656602.787924:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790656602.788140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656602.788176:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656602.788184:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:0.0:1790656602.788187:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790656602.788190:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:0.0:1790656602.788256:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+28:11029:x1877639248823040:12345-192.168.203.23@tcp:101:bash.0 Request processed in 6790us (7033us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1790656602.788264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:0.0:1790656602.792356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656602.792641:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823424 00000100:00100000:2.0:1790656602.792674:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823424 00000100:00100000:2.0:1790656602.792749:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:2.0:1790656602.792762:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+28:11029:x1877639248823424:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:2.0:1790656602.793459:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.793481:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.793495:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656602.793560:0:6714:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1790656602.793821:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add50403 reply state 000000005d874865 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656602.793834:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790656602.794105:0:6714:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1790656602.794326:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+32:11029:x1877639248823424:12345-192.168.203.23@tcp:36:bash.0 Request processed in 1561us (1983us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1790656602.794337:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000020:00080000:2.0:1790656602.794345:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790656602.798875:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:1.0:1790656602.799201:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799216:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799225:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799232:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656602.799238:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799262:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799284:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:1.0:1790656602.799287:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656602.799294:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.799300:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb7df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656602.799796:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823552 00000100:00100000:3.0:1790656602.799808:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823552 00000100:00100000:3.0:1790656602.799919:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:3.0:1790656602.800085:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+31:11029:x1877639248823552:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656602.800118:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656602.800141:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379d8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.800223:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d8 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.800240:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d8 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.800280:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656602.800283:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656602.800286:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96200, rc 0) 00000100:00100000:3.0:1790656602.800373:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+32:11029:x1877639248823552:12345-192.168.203.23@tcp:101:bash.0 Request processed in 445us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656602.800381:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1790656602.803505:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656602.803642:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823680 00000100:00100000:1.0:1790656602.803655:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823680 00000100:00100000:1.0:1790656602.803736:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1790656602.803748:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:11029:x1877639248823680:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656602.803772:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656602.803798:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379df expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656602.803831:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abb4055, atime: 0x6abb4053, ctime: 0x6abb4055, blocks: 0xb 00010000:00010000:1.0:1790656602.803858:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1790656602.803864:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656602.803874:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.803896:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 8 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656602.803910:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06600, rc 0) 00000100:00080000:2.0:1790656602.804029:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656602.804223:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+8:11029:x1877639248823680:12345-192.168.203.23@tcp:101:bash.0 Request processed in 475us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656602.804231:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:2.0:1790656602.806913:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.807077:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823808 00000100:00100000:3.0:1790656602.807090:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823808 00002000:00010000:3.0:1790656602.807142:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1790656602.807147:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fbcf480 with x1877639248823808 ext(0->18446744073709551615) 00002000:00010000:3.0:1790656602.807174:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393fbcf480. 00000100:00100000:3.0:1790656602.807211:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656602.807222:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+8:2340:x1877639248823808:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:3.0:1790656602.808423:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790656602.808503:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790656597 -> 1790656602 00002000:00010000:3.0:1790656602.808506:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790656595 -> 1790656595 00002000:00010000:3.0:1790656602.808509:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790656597 -> 1790656602 00002000:00010000:3.0:1790656602.808512:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790656602.808741:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+9:2340:x1877639248823808:12345-192.168.203.23@tcp:10:bash.0 Request processed in 1515us (1834us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790656602.808771:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00002000:00010000:3.0:1790656602.808778:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1790656602.808782:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fbcf480 with x1877639248823808 ext(0->18446744073709551615) 00002000:00010000:3.0:1790656602.808790:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393fbcf480. 00010000:00010000:0.0:1790656602.847083:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656602.886462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.892924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248823936 00000100:00100000:3.0:1790656602.892943:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248823936 00000100:00100000:3.0:1790656602.893034:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:3.0:1790656602.893047:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+32:11516:x1877639248823936:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:3.0:1790656602.893146:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893168:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893185:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893204:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893213:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893221:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893726:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893737:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893751:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656602.893927:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893941:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893947:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893954:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893961:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.893966:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893975:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.893989:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656602.893992:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.893998:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894005:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066eb7f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894020:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894033:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894039:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.894047:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894053:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894060:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3100) 00010000:00010000:3.0:1790656602.894063:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.894067:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894073:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066eb7fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894091:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894097:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894103:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894108:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.894116:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894122:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894129:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656602.894132:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.894135:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.894141:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656602.894515:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+32:11516:x1877639248823936:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1466us (8065us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656602.894526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:0.0:1790656602.973370:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656602.973458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248824192 00000100:00100000:3.0:1790656602.973483:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248824192 00000100:00100000:3.0:1790656602.973562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:3.0:1790656602.973573:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943803248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:11519:x1877639248824192:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656602.973646:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656602.973675:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379e6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973772:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973789:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973826:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973843:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973850:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.973856:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.974814:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35400/0x9c3a6e82066eb81e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.974831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35400/0x9c3a6e82066eb81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.974841:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35400/0x9c3a6e82066eb81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656602.974855:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790656602.974976:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.974984:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.974992:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975000:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.975015:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975025:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975040:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656602.975044:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.975049:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975056:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975071:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975077:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975083:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975089:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656602.975092:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975098:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975106:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3100) 00010000:00010000:3.0:1790656602.975108:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656602.975118:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.975125:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.976532:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379e6 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.976588:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35400/0x9c3a6e82066eb81e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379e6 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656602.976622:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656602.976626:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790656602.976629:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be35400, rc 0) 00000100:00100000:3.0:1790656602.976724:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943803248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+34:11519:x1877639248824192:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 3152us (3368us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1790656602.976734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:0.0:1790656602.988567:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656602.988828:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248824320 00000100:00100000:2.0:1790656602.988844:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248824320 00000100:00100000:2.0:1790656602.988922:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:2.0:1790656602.988935:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390977d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:11519:x1877639248824320:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1790656602.989029:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.989070:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.989081:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.989127:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656602.989144:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 34 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656602.989161:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269785728:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656602.989295:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439031060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656603.000542:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.000876:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248824576 00000100:00100000:3.0:1790656603.000886:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248824576 00000100:00100000:3.0:1790656603.000940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1790656603.000949:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+35:5581:x1877639248824576:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790656603.001395:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+36:5581:x1877639248824576:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 444us (866us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1790656603.001404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1790656603.001768:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1877639269785728:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656603.001802:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.008558:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.010415:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248824704 00000100:00100000:2.0:1790656603.010447:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248824704 00010000:00010000:2.0:1790656603.010516:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 36 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.010572:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:2.0:1790656603.010583:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+36:2341:x1877639248824704:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656603.010629:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656603.010656:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 36 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010670:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 36 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010698:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066eb7d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d1 expref: 36 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010719:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:2.0:1790656603.010726:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010736:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010746:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.010789:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656603.010873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+35:2341:x1877639248824704:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 291us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.010881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00010000:00010000:0.0:1790656603.012169:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012184:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012225:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012233:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012266:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012275:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656603.012280:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012288:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012304:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:0.0:1790656603.012308:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656603.012313:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.012320:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb82c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.012410:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390977d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+34:11519:x1877639248824320:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 23473us (23855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.012420:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:0.0:1790656603.019652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.019855:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248824960 00000100:00100000:3.0:1790656603.019869:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248824960 00000100:00100000:3.0:1790656603.019940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1790656603.019954:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+34:11519:x1877639248824960:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656603.020277:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+35:11519:x1877639248824960:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 326us (639us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1790656603.020286:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1790656603.130000:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.130175:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248825216 00000100:00100000:3.0:1790656603.130189:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248825216 00000100:00100000:3.0:1790656603.130282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:3.0:1790656603.130294:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+35:11530:x1877639248825216:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1790656603.130326:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656603.130351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379ed expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130446:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130464:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130478:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130495:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130503:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.130509:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.133843:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35800/0x9c3a6e82066eb848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.133880:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35800/0x9c3a6e82066eb848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.133898:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35800/0x9c3a6e82066eb848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656603.133914:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790656603.134310:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134320:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134327:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134334:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656603.134339:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134348:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656603.134368:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656603.134374:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134381:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb83a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134398:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134413:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134419:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134425:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656603.134428:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134434:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134444:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3100) 00010000:00010000:3.0:1790656603.134447:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656603.134450:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134458:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.134527:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ed expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.136136:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35800/0x9c3a6e82066eb848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ed expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.136159:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:3.0:1790656603.136162:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656603.136187:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be35800, rc 0) 00000100:00100000:3.0:1790656603.136312:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+37:11530:x1877639248825216:12345-192.168.203.23@tcp:101:cat.0 Request processed in 6015us (6322us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790656603.136323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:1.0:1790656603.139842:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.142865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248825472 00000100:00100000:3.0:1790656603.142887:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248825472 00000100:00100000:3.0:1790656603.142986:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1790656603.143000:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+37:11530:x1877639248825472:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:3.0:1790656603.143364:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+38:11530:x1877639248825472:12345-192.168.203.23@tcp:35:cat.0 Request processed in 365us (3535us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790656603.143372:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1790656603.179993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.189685:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248825728 00000100:00100000:3.0:1790656603.189708:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248825728 00000100:00100000:2.0:1790656603.190282:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:2.0:1790656603.190296:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+38:11531:x1877639248825728:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:2.0:1790656603.190372:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790656603.190407:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35800/0x9c3a6e82066eb848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379ed expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190459:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35400/0x9c3a6e82066eb81e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379e6 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190483:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066eb7e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379d8 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190495:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9439086c3300) 00010000:00010000:2.0:1790656603.190508:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656603.190536:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190572:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190656:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190665:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.190671:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.191834:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.191852:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.191886:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656603.192703:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790656603.192717:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318329124647ns, next at 319329121532ns, rc = 0 00010000:00010000:2.0:1790656603.192791:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192804:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192825:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192831:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192838:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192869:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790656603.192899:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192906:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192912:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192926:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.192932:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192941:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4ad00) 00010000:00010000:2.0:1790656603.192960:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790656603.192966:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192972:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb864 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.192994:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193000:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193006:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193011:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.193014:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193020:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193037:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656603.193040:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656603.193043:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.193049:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb856 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790656603.193060:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaa9fd53 reply state 000000004a9bec84 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.193070:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656603.193177:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+37:11531:x1877639248825728:12345-192.168.203.23@tcp:36:rm.0 Request processed in 2879us (13209us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790656603.193187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 197 00010000:00010000:3.0:1790656603.194993:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656603.195012:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.195026:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656603.195031:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.195042:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.195064:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943909b4ad00) 00010000:00010000:3.0:1790656603.195066:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790656603.195071:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.195076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb86b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.195130:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656603.195132:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656603.195135:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656603.197447:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197480:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197489:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197495:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.197501:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197510:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197854:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943909b4ab00) 00010000:00010000:2.0:1790656603.197860:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656603.197866:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.197874:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eb85d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.271952:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.272212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248825984 00000100:00100000:3.0:1790656603.272227:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248825984 00000100:00100000:3.0:1790656603.272337:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:3.0:1790656603.272351:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+36:11537:x1877639248825984:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656603.272388:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656603.272417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb872 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379f4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272651:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272687:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272704:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272711:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.272717:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790656603.273431:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790656603.273709:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273721:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273731:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273773:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273780:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273787:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273794:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656603.273799:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273808:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273824:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656603.273827:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656603.273833:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273839:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb879 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656603.273867:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cb54830 reply state 000000004993a30d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656603.273877:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790656603.273918:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb872 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273936:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.273945:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:3.0:1790656603.273947:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656603.273950:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be34800, rc 0) 00000100:00100000:3.0:1790656603.274052:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+39:11537:x1877639248825984:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1703us (2113us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790656603.274062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 198 00010000:00010000:2.0:1790656603.280916:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.280940:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.280949:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.280956:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.280961:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.280969:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.280991:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3100) 00010000:00010000:2.0:1790656603.280994:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656603.281000:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.281006:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34400/0x9c3a6e82066eb880 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.296382:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.296505:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248826112 00000100:00100000:2.0:1790656603.296520:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248826112 00000100:00100000:2.0:1790656603.296672:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1790656603.296686:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248826112:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656603.296712:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656603.296749:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a2379fb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790656603.296785:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790656603.296810:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1790656603.296815:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656603.296827:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.296861:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.296877:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656603.296954:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2342:x1877639248826112:12345-192.168.203.23@tcp:101:bash.0 Request processed in 271us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.296962:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00080000:0.0:1790656603.297630:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656603.302083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.304893:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248826240 00000100:00100000:0.0:1790656603.304917:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248826240 00000100:00100000:0.0:1790656603.305031:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1790656603.305044:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+6:11537:x1877639248826240:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656603.305089:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656603.305117:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a02 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.305161:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.305171:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656603.305175:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656603.305181:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.305223:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.305256:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.305273:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1877639269785856:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656603.305405:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790656603.312831:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1877639269785856:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656603.312886:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.312914:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506a00, rc 0) 00000100:00100000:0.0:1790656603.313014:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:11537:x1877639248826240:12345-192.168.203.23@tcp:101:bash.0 Request processed in 7971us (10946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.313025:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:1.0:1790656603.314419:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.320810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248826368 00000100:00100000:2.0:1790656603.320833:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248826368 00010000:00010000:2.0:1790656603.320908:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.321075:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1790656603.321088:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248826368:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656603.321110:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656603.321141:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.321159:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.321191:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000114ef50d/0x9c3a6e82066eb895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379fb expref: 7 pid: 6692 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.321223:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656603.321228:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656603.321912:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.321927:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.321997:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.322016:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1877639269785984:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656603.322151:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656603.330081:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1877639269785984:192.168.203.23@tcp:105: 00010000:00010000:1.0:1790656603.330119:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656603.331293:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248826368:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 10195us (16871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656603.331310:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1790656603.343107:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.345855:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248826624 00000100:00100000:3.0:1790656603.345876:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248826624 00000100:00100000:3.0:1790656603.345967:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1790656603.345981:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+38:11537:x1877639248826624:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1790656603.346498:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+39:11537:x1877639248826624:12345-192.168.203.23@tcp:35:bash.0 Request processed in 517us (3402us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1790656603.346506:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1790656603.539097:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.539221:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248826752 00000100:00100000:0.0:1790656603.539236:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248826752 00000100:00100000:0.0:1790656603.539326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:0.0:1790656603.539348:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+39:11553:x1877639248826752:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656603.539381:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656603.539411:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a09 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539517:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539535:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656603.539815:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790656603.539820:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656603.539842:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539871:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a09 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539895:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a09 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.539930:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656603.539933:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656603.539938:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506200, rc 0) 00000100:00100000:0.0:1790656603.540010:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+40:11553:x1877639248826752:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 674us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.540017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1790656603.551145:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656603.551210:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827008 00000100:00100000:1.0:1790656603.551224:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827008 00000100:00100000:1.0:1790656603.551772:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:1.0:1790656603.551787:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+40:11553:x1877639248827008:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656603.551815:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656603.551843:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb8b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a10 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.551978:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb8b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.551996:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.552011:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656603.552024:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790656603.552189:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb8b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a10 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.552212:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a10 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.552260:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:1.0:1790656603.552264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656603.552270:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07200, rc 0) 00000100:00100000:1.0:1790656603.552361:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+42:11553:x1877639248827008:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 578us (1231us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1790656603.552370:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:1.0:1790656603.558663:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.558757:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827264 00000100:00100000:0.0:1790656603.558774:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827264 00000100:00100000:0.0:1790656603.558856:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:0.0:1790656603.558868:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+42:11553:x1877639248827264:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656603.558902:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656603.558927:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb8c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a17 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.559049:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.559068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.559081:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656603.559097:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790656603.559276:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb8c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a17 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.559323:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a17 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.559333:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:0.0:1790656603.559347:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790656603.559352:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507800, rc 0) 00000100:00100000:0.0:1790656603.559452:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+44:11553:x1877639248827264:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 586us (803us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1790656603.559461:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:2.0:1790656603.561968:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.562108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827392 00000100:00100000:3.0:1790656603.562120:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827392 00000100:00100000:3.0:1790656603.562201:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1790656603.562230:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+44:2340:x1877639248827392:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656603.562258:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656603.562289:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07200/0x9c3a6e82066eb8b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a10 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.562310:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:3.0:1790656603.562316:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656603.562385:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+43:2340:x1877639248827392:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 158us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656603.562393:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1790656603.571091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.571446:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827520 00000100:00100000:2.0:1790656603.571458:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827520 00000100:00100000:2.0:1790656603.571906:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1790656603.571922:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+6:2341:x1877639248827520:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:2.0:1790656603.571984:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.572009:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.572019:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656603.572025:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656603.572031:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.572074:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.572090:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 6 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.572107:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269786112:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656603.572252:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790656603.575897:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.576013:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827648 00000100:00100000:0.0:1790656603.576027:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827648 00002000:00100000:0.0:1790656603.576094:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94392da08e00 x1877639248827648/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:464/0 lens 504/0 e 0 to 0 dl 1790656614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656603.576107:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94392da08e00 with x1877639248827648 ext(0->8) 00010000:00010000:0.0:1790656603.576119:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 7 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.576137:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 7 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656603.576147:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94392da08e00 00000100:00100000:0.0:1790656603.576190:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1790656603.576201:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248827648:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:0.0:1790656603.576924:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:177b5748-b800-471f-9375-621ebde8193b+9:2342:x1877639248827648:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 719us (1037us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790656603.576942:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:0.0:1790656603.576952:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94392da08e00 x1877639248827648/t4294967308(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:464/0 lens 504/448 e 0 to 0 dl 1790656614 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790656603.576961:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94392da08e00 with x1877639248827648 ext(0->8) 00010000:00010000:0.0:1790656603.576968:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.576985:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656603.576993:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff94392da08e00 00000100:00100000:2.0:1790656603.579030:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1877639269786112:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656603.579072:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656603.581637:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.581956:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248827776 00000100:00100000:2.0:1790656603.581970:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248827776 00010000:00010000:2.0:1790656603.582027:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.582084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:2.0:1790656603.582096:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248827776:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656603.582115:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790656603.582137:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790656603.582140:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790656602 00002000:00010000:2.0:1790656603.582143:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790656602 00002000:00010000:2.0:1790656603.582146:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790656602 00010000:00010000:2.0:1790656603.582153:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.582168:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.582198:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066eb89c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a02 expref: 9 pid: 6691 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.582254:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656603.582259:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656603.582266:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.582277:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.582316:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656603.582392:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248827776:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 297us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.582401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00010000:00010000:1.0:1790656603.583339:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583355:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583390:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583399:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583408:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583445:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656603.583450:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583460:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583476:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656603.583484:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445e74f6/0x9c3a6e82066eb8db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656603.583878:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248827520:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 11957us (12798us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656603.583888:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1790656603.588376:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656603.588829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828032 00000100:00100000:1.0:1790656603.588844:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828032 00000100:00100000:0.0:1790656603.589217:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1790656603.589230:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439073c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+43:11553:x1877639248828032:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:0.0:1790656603.589323:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a17 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656603.590255:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1790656603.590317:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1790656603.591255:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1790656603.591341:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.591362:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.591372:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.594130:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.594163:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 47 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.594187:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877639269786240:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656603.594480:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1790656603.599205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.599303:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828160 00000100:00100000:3.0:1790656603.599318:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828160 00010000:00010000:3.0:1790656603.599372:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 48 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656603.599420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656603.599441:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+48:2342:x1877639248828160:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656603.599459:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656603.599467:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 48 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.599482:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 48 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.599511:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:3.0:1790656603.599518:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.599566:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.599574:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.599622:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656603.599770:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34800/0x9c3a6e82066eb887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379f4 expref: 48 pid: 5844 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.599792:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1877639269786240:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656603.599823:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.599835:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.599840:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656603.600013:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1790656603.600263:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1790656603.600393:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269786368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656603.600455:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656603.600494:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc000 going to sleep for 11 seconds 00000100:00100000:0.0:1790656603.600524:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269786368 00000100:00100000:0.0:1790656603.600541:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269786368 00000100:00100000:0.0:1790656603.600622:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656603.600631:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269786368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656603.600711:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269786368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.600717:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656603.600756:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269786368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790656603.601235:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790656603.601310:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269786496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656603.601339:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656603.601360:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1790656603.601376:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269786496 00000100:00100000:0.0:1790656603.601380:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269786496 00000100:00100000:0.0:1790656603.601403:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790656603.601410:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877639269786496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790656603.601553:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1877639269786496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (212us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790656603.601559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790656603.601613:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1877639269786496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790656603.601654:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1790656603.601689:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601700:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601708:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601723:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656603.601728:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601737:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601755:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:0.0:1790656603.601758:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790656603.601764:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.601771:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790656603.601965:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790656603.602071:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1790656603.602083:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318738490875ns, next at 319738488277ns, rc = 0 00000001:00080000:0.0:1790656603.602089:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1790656603.602123:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9439086c3500) 00010000:00010000:0.0:1790656603.602128:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790656603.602135:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a17 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656603.603095:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+51:2342:x1877639248828160:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3646us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656603.603108:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:0.0:1790656603.603255:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439073c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+50:11553:x1877639248828032:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 14026us (14891us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1790656603.603266:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000020:00080000:0.0:1790656603.603271:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790656603.607059:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.607236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828288 00000100:00100000:0.0:1790656603.607259:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828288 00000100:00100000:0.0:1790656603.607372:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:0.0:1790656603.607384:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+50:11553:x1877639248828288:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656603.607416:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656603.607465:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb8e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a1e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.607937:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a1e expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.607958:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a1e expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.607984:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656603.607987:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790656603.607991:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507400, rc 0) 00000100:00100000:0.0:1790656603.608064:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+51:11553:x1877639248828288:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 682us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.608072:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:2.0:1790656603.611378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656603.612082:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828544 00000100:00100000:1.0:1790656603.612098:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828544 00000100:00100000:1.0:1790656603.612178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1790656603.612189:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+51:11553:x1877639248828544:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1790656603.612946:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+52:11553:x1877639248828544:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 752us (1577us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790656603.612975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1790656603.694186:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.694961:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828672 00000100:00100000:0.0:1790656603.694976:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828672 00000100:00100000:0.0:1790656603.695093:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1790656603.695105:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:11563:x1877639248828672:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1790656603.695217:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695239:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695285:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695302:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695310:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695316:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695443:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695452:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695459:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656603.695525:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695557:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695565:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695572:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695613:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656603.695619:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695627:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695642:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656603.695646:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656603.695652:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695658:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb8f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695672:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695677:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695682:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695687:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656603.695689:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695695:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695713:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94391836db00) 00010000:00010000:0.0:1790656603.695715:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656603.695718:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb8f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695741:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695747:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695753:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695759:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656603.695762:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695768:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695775:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656603.695777:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656603.695780:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.695785:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb8fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.695908:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+52:11563:x1877639248828672:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 804us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.695917:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:2.0:1790656603.748929:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.749983:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248828928 00000100:00100000:3.0:1790656603.749999:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248828928 00000100:00100000:3.0:1790656603.750143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:3.0:1790656603.750157:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+52:11566:x1877639248828928:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656603.750185:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656603.750213:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb905 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a25 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750324:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750357:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750373:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750403:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750409:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750640:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35600/0x9c3a6e82066eb91a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750649:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35600/0x9c3a6e82066eb91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750656:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35600/0x9c3a6e82066eb91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656603.750667:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790656603.750792:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750800:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750807:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750814:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656603.750819:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750828:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750852:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656603.750855:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656603.750861:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750868:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb90c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750885:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750892:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750897:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750902:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656603.750904:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750909:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750916:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439086c3900) 00010000:00010000:3.0:1790656603.750918:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656603.750921:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750926:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.750986:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a25 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.751000:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35600/0x9c3a6e82066eb91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a25 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.751008:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656603.751009:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656603.751012:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be35600, rc 0) 00000100:00100000:3.0:1790656603.751087:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+54:11566:x1877639248828928:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 934us (2174us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790656603.751096:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:1.0:1790656603.760298:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656603.760626:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248829056 00000100:00100000:2.0:1790656603.760640:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248829056 00000100:00100000:2.0:1790656603.760724:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:2.0:1790656603.760738:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:11566:x1877639248829056:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1790656603.760842:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760866:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760882:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760933:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760940:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760947:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760954:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.760959:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760968:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760981:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656603.760985:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656603.760991:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.760998:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.761106:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+54:11566:x1877639248829056:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 372us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.761114:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:2.0:1790656603.767392:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.767522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248829312 00000100:00100000:3.0:1790656603.767534:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248829312 00000100:00100000:3.0:1790656603.767637:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1790656603.767649:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+54:11566:x1877639248829312:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656603.767938:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+55:11566:x1877639248829312:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 290us (558us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790656603.767947:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1790656603.807214:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656603.807255:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269786624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656603.807350:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656603.807891:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269786624 00000100:00100000:2.0:1790656603.807916:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269786624 00000100:00100000:2.0:1790656603.808003:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790656603.808015:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269786624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656603.808065:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656603.808136:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269786624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.808144:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790656603.808336:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269786624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790656603.871056:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656603.873120:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.873256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248829568 00000100:00100000:0.0:1790656603.873270:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248829568 00000100:00100000:0.0:1790656603.873345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:0.0:1790656603.873356:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+55:11576:x1877639248829568:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1790656603.873391:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656603.873394:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790656603.873437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb8aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a09 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.873470:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656603.873477:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656603.873500:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb92f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a2c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.874008:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.874029:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.874043:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656603.874074:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790656603.874203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507200/0x9c3a6e82066eb92f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a2c expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.874222:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a2c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.874230:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656603.874233:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656603.874236:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507800, rc 0) 00000100:00100000:0.0:1790656603.874317:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+56:11576:x1877639248829568:12345-192.168.203.23@tcp:101:bash.0 Request processed in 962us (1214us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790656603.874326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:2.0:1790656603.878879:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656603.879255:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248829824 00000100:00100000:0.0:1790656603.879269:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248829824 00000100:00100000:0.0:1790656603.879343:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:0.0:1790656603.879354:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+56:11576:x1877639248829824:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1790656603.879449:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790656603.879485:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eb936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a2c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.879510:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35600/0x9c3a6e82066eb91a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a25 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.879522:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656603.879527:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656603.879874:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.879889:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656603.880336:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656603.880408:0:6714:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1790656603.880530:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000998ddcff reply state 00000000e1dab761 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656603.880623:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656603.880767:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+57:11576:x1877639248829824:12345-192.168.203.23@tcp:36:bash.0 Request processed in 1412us (1899us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1790656603.880776:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 207 00000020:00080000:0.0:1790656603.880782:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790656603.884586:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884650:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884658:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884665:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656603.884671:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884681:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884702:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656603.884706:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656603.884712:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656603.884718:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506200/0x9c3a6e82066eb944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656603.888088:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.888293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248829952 00000100:00100000:3.0:1790656603.888307:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248829952 00000100:00100000:3.0:1790656603.888382:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:3.0:1790656603.888394:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+56:11576:x1877639248829952:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1790656603.888433:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656603.888471:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb94b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a33 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888665:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888684:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888697:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656603.888733:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790656603.888739:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656603.888763:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888792:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb94b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888815:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656603.888824:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656603.888828:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656603.888832:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be34200, rc 0) 00000100:00100000:3.0:1790656603.888896:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+57:11576:x1877639248829952:12345-192.168.203.23@tcp:101:bash.0 Request processed in 504us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656603.888904:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:1.0:1790656603.893205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.893305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830208 00000100:00100000:3.0:1790656603.893318:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830208 00000100:00100000:3.0:1790656603.893401:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1790656603.893412:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+57:11576:x1877639248830208:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1790656603.893850:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+58:11576:x1877639248830208:12345-192.168.203.23@tcp:35:bash.0 Request processed in 437us (657us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1790656603.893859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:1.0:1790656603.903146:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656603.903191:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656603.903233:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656603.903324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830336 00000100:00100000:3.0:1790656603.903337:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830336 00000100:00100000:3.0:1790656603.903409:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:3.0:1790656603.903431:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248830336:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656603.903535:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248830336:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 116us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.903758:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830464 00000100:00100000:0.0:1790656603.903763:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830464 00000100:00100000:0.0:1790656603.903799:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:0.0:1790656603.903805:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+9:2339:x1877639248830464:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656603.903837:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+9:2339:x1877639248830464:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656603.903845:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:3.0:1790656603.904452:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:2.0:1790656603.905915:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830592 00000100:00100000:2.0:1790656603.905932:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830592 00000100:00100000:2.0:1790656603.906029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:2.0:1790656603.906040:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248830592:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656603.906145:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248830592:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 106us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656603.906152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00080000:0.0:1790656603.906251:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656604.016649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.017443:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830720 00000100:00100000:3.0:1790656604.017466:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830720 00000100:00100000:3.0:1790656604.017625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:3.0:1790656604.017641:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+58:11582:x1877639248830720:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656604.017676:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656604.017706:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.017805:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.017823:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.017838:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656604.017910:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790656604.017915:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656604.017939:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.017969:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a3a expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.017992:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a3a expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.018000:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656604.018004:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656604.018009:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be35c00, rc 0) 00000100:00100000:3.0:1790656604.019830:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248830720:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2179us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.019847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00080000:0.0:1790656604.020125:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656604.033050:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656604.034250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830848 00000100:00100000:2.0:1790656604.034271:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830848 00000100:00100000:2.0:1790656604.034431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:2.0:1790656604.034444:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248830848:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656604.034491:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656604.034525:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a41 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.034971:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.034992:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035004:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035020:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035056:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035311:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035322:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035330:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656604.035371:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790656604.035376:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656604.035398:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035411:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035419:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035425:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035432:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035448:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656604.035453:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035869:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035884:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656604.035888:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656604.035962:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eb96e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035989:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.035997:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.036004:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.036010:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656604.036013:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.036031:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.036053:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943909b4a300) 00010000:00010000:2.0:1790656604.036056:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656604.036059:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.036066:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eb975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.037362:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066eb967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.037390:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.037399:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656604.037402:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656604.037405:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656604.038380:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+60:11582:x1877639248830848:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 3930us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656604.038395:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:2.0:1790656604.045171:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656604.045274:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.045344:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248831232 00000100:00100000:1.0:1790656604.045357:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248831232 00000100:00100000:1.0:1790656604.045424:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:1.0:1790656604.045442:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+60:11582:x1877639248831232:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656604.045475:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656604.045507:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045690:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045699:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045737:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045777:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045791:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.045806:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269786752:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656604.045924:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.045933:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 61 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.045942:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94380324ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269786880:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656604.045963:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94840 going to sleep for 11 seconds 00000100:00100000:3.0:1790656604.050348:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248830976 00000100:00100000:3.0:1790656604.050371:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248830976 00010000:00010000:3.0:1790656604.050852:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 62 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656604.050945:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1790656604.050957:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+62:2341:x1877639248830976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656604.050976:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656604.050984:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 62 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.051017:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 62 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.051047:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656604.051054:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.051065:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.051082:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656604.051158:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+62:2341:x1877639248830976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 203us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.051165:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1790656604.055296:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.055634:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248831360 00000100:00100000:3.0:1790656604.055647:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248831360 00010000:00010000:3.0:1790656604.055703:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 62 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656604.055752:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1790656604.055764:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+62:2342:x1877639248831360:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656604.055784:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656604.055792:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 62 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.055808:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 62 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.055849:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656604.055855:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.055865:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.055874:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.055898:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656604.055973:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+62:2342:x1877639248831360:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 211us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.055979:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00010000:00010000:1.0:1790656604.058126:0:5845:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.23@tcp) returned -22 from blocking AST (req@00000000743c646b x1877639269786752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.058158:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480e00/0x9c3a6e82066eb97c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a41 expref: 61 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.058180:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269786752:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656604.058233:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34200/0x9c3a6e82066eb952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a33 expref: 60 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.058256:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94380324ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1877639269786880:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656604.058287:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656604.058297:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.058306:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.058312:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656604.058341:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790656604.058585:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.058652:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.058660:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656604.058663:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790656604.058666:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07000, rc 0) 00000100:00100000:1.0:1790656604.058747:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+60:11582:x1877639248831232:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 13306us (13470us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790656604.058756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:2.0:1790656604.061654:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.061845:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248831616 00000100:00100000:3.0:1790656604.061859:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248831616 00000100:00100000:3.0:1790656604.061942:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1790656604.061954:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+60:11582:x1877639248831616:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1790656604.061973:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656604.062003:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507400/0x9c3a6e82066eb8e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a1e expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.062025:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656604.062030:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656604.062094:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248831616:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 142us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.062101:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1790656604.066424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.066516:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248831744 00000100:00100000:3.0:1790656604.066530:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248831744 00000100:00100000:3.0:1790656604.066644:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:3.0:1790656604.066657:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248831744:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:3.0:1790656604.066795:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.066819:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.066834:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790656604.067202:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790656604.067392:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248831744:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 736us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.067401:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:0.0:1790656604.070707:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.070823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248831872 00000100:00100000:3.0:1790656604.070836:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248831872 00000100:00100000:3.0:1790656604.070908:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:3.0:1790656604.070919:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+59:11582:x1877639248831872:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656604.070947:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656604.070974:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a4f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071051:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071063:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071096:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071115:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071134:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:3.0:1790656604.071137:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790656604.071142:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.071150:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be34a00, rc 0) 00000100:00100000:3.0:1790656604.071223:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+60:11582:x1877639248831872:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 307us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.071229:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000040:00080000:3.0:1790656604.638925:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790656604.638938:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790656604.639168:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1790656604.639177:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790656604.639350:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935264700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269787008:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790656604.639492:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656604.652706:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.652988:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248832000 00000100:00100000:3.0:1790656604.653000:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248832000 00000100:00100000:3.0:1790656604.653095:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:3.0:1790656604.653117:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832000:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790656604.653162:0:6714:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790656604.653327:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832000:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 212us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.653343:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:3.0:1790656604.653399:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935264700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269787008:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790656604.670998:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.671256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248832128 00000100:00100000:0.0:1790656604.671270:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248832128 00000100:00100000:0.0:1790656604.671402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:0.0:1790656604.671414:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+60:11584:x1877639248832128:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790656604.671513:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.671532:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.671556:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675340:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675364:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675377:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675409:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675417:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675423:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656604.675486:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790656604.675491:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656604.675504:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675515:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675522:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675528:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675534:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656604.675539:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675545:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675557:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:0.0:1790656604.675560:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656604.675565:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675572:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506a00/0x9c3a6e82066eb9a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.675587:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677528:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677537:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677544:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656604.677548:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677557:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677573:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff94391836d500) 00010000:00010000:0.0:1790656604.677576:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656604.677581:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.677588:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678104:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678116:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678123:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678128:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656604.678138:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678145:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678506:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656604.678511:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656604.678516:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.678523:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656604.679187:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+60:11584:x1877639248832128:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 7768us (8195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.679198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:0.0:1790656604.686904:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.687251:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248832384 00000100:00100000:1.0:1790656604.687269:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248832384 00000100:00100000:1.0:1790656604.687350:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:1.0:1790656604.687364:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+60:11584:x1877639248832384:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656604.687391:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656604.688941:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb9bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a56 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.690015:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.690049:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.690065:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656604.690368:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790656604.691486:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.691503:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.691511:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.691517:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f07a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656604.691523:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.691531:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.691571:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656604.691574:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790656604.692078:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.692088:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.692182:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb9bb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a56 expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.692196:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:1.0:1790656604.692199:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656604.692203:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb9bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a56 expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.692214:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07e00, rc 0) 00000100:00100000:1.0:1790656604.692326:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832384:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4964us (5431us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1790656604.692338:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:1.0:1790656604.699870:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.703783:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248832512 00000100:00100000:3.0:1790656604.703805:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248832512 00000100:00100000:3.0:1790656604.703889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:3.0:1790656604.703899:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832512:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790656604.703948:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790656604.704167:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832512:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 268us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.704175:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:2.0:1790656604.716383:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.720219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248832768 00000100:00100000:0.0:1790656604.720252:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248832768 00000100:00100000:0.0:1790656604.720407:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:0.0:1790656604.720429:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248832768:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656604.720458:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656604.720462:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790656604.720504:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35c00/0x9c3a6e82066eb960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a3a expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.720530:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:0.0:1790656604.720547:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656604.720782:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a5d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790656604.721287:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1790656604.723012:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.723038:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.723052:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.723136:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eb9d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a5d expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.723370:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a5d expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.723383:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94391836d500) 00010000:00010000:0.0:1790656604.723386:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656604.723390:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506400, rc 0) 00000100:00100000:0.0:1790656604.723931:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+62:11584:x1877639248832768:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3501us (7559us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1790656604.723942:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:2.0:1790656604.733051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.733247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833024 00000100:00100000:3.0:1790656604.733261:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833024 00000100:00100000:3.0:1790656604.733366:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:3.0:1790656604.733379:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+62:11584:x1877639248833024:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790656604.733458:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656604.733502:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506400/0x9c3a6e82066eb9d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a5d expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733528:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94391836d500) 00010000:00010000:3.0:1790656604.733792:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790656604.733822:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733839:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733869:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733887:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733893:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733900:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733977:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733985:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733993:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.733999:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656604.734004:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734013:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734022:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:3.0:1790656604.734025:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656604.734029:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734042:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eb9e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734053:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734058:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734063:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734068:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656604.734071:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734077:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734085:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf02adc3f (ffff9439086c3900) 00010000:00010000:3.0:1790656604.734087:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656604.734090:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.734096:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eb9ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf02adc3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656604.734339:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248833024:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 961us (1302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790656604.734349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:2.0:1790656604.737871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.737980:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833152 00000100:00100000:1.0:1790656604.737993:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833152 00000100:00100000:1.0:1790656604.738060:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:1.0:1790656604.738072:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+61:11584:x1877639248833152:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656604.738097:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656604.738126:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb9f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a64 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738294:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738311:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738324:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738438:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eb9f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 63 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738459:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 62 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.738549:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:1.0:1790656604.738553:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790656604.738557:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07a00, rc 0) 00000100:00100000:1.0:1790656604.738766:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+62:11584:x1877639248833152:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 695us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656604.738773:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:2.0:1790656604.742882:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.742977:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833408 00000100:00100000:0.0:1790656604.742990:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833408 00000100:00100000:0.0:1790656604.743060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:0.0:1790656604.743072:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+62:11584:x1877639248833408:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790656604.743211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.743243:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.743258:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656604.743570:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1790656604.743582:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319879989750ns, next at 320879986602ns, rc = 0 00000004:00010000:0.0:1790656604.743730:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fb15aad reply state 00000000382059f7 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656604.743741:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656604.743856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+64:11584:x1877639248833408:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 785us (987us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790656604.743864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00010000:00010000:0.0:1790656604.747132:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747163:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747173:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747180:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656604.747185:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747219:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747248:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:0.0:1790656604.747252:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790656604.747259:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.747266:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506e00/0x9c3a6e82066eba01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656604.749783:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.750009:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833536 00000100:00100000:1.0:1790656604.750022:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833536 00000100:00100000:1.0:1790656604.750096:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:1.0:1790656604.750108:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+63:11584:x1877639248833536:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656604.750141:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656604.750299:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a6b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.750392:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 64 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.750408:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 64 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.750431:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:1.0:1790656604.750435:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656604.750439:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07c00, rc 0) 00000100:00100000:1.0:1790656604.750805:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+64:11584:x1877639248833536:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 697us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656604.750814:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:2.0:1790656604.755047:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.755864:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833664 00000100:00100000:3.0:1790656604.756003:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833664 00000100:00100000:3.0:1790656604.756141:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1790656604.756166:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248833664:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790656604.756622:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+10:2341:x1877639248833664:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 468us (1588us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790656604.756630:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1790656604.760061:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.760230:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248833920 00000100:00100000:3.0:1790656604.760251:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248833920 00000100:00100000:3.0:1790656604.760320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1790656604.760332:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+64:11584:x1877639248833920:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790656604.760979:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+65:11584:x1877639248833920:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 646us (930us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1790656604.760989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00080000:0.0:1790656604.761460:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656604.765255:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.765388:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834176 00000100:00100000:0.0:1790656604.765402:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834176 00000100:00100000:0.0:1790656604.765766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:0.0:1790656604.765778:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+65:11584:x1877639248834176:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790656604.765940:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+65:11584:x1877639248834176:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 163us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.765949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:2.0:1790656604.769796:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.769921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834304 00000100:00100000:3.0:1790656604.769935:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834304 00000100:00100000:3.0:1790656604.770008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:3.0:1790656604.770021:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+65:11584:x1877639248834304:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656604.770049:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656604.770076:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eba0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770341:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770359:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770392:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656604.770438:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656604.770459:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770668:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35200/0x9c3a6e82066eba0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a72 expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770691:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a72 expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.770701:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:3.0:1790656604.770704:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790656604.770709:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be34e00, rc 0) 00000100:00100000:3.0:1790656604.770788:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+66:11584:x1877639248834304:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 769us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.770796:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:1.0:1790656604.776303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.776404:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834432 00000100:00100000:0.0:1790656604.776428:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834432 00000100:00100000:0.0:1790656604.776519:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1790656604.776531:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94380324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+10:2339:x1877639248834432:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656604.776565:0:8825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656604.776627:0:8825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a79 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656604.776690:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abb405b, blocks: 0x1 00010000:00010000:0.0:1790656604.776716:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1790656604.776721:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656604.776733:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 11 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.776752:0:8825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 11 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.776767:0:8825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506e00, rc 0) 00000100:00100000:0.0:1790656604.776849:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94380324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+11:2339:x1877639248834432:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 319us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.776857:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1790656604.780887:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.781045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834688 00000100:00100000:0.0:1790656604.781058:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834688 00000100:00100000:0.0:1790656604.781140:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:0.0:1790656604.781332:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+66:11584:x1877639248834688:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790656604.781946:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+66:11584:x1877639248834688:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 792us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.781956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:3.0:1790656604.786250:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.786798:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834816 00000100:00100000:0.0:1790656604.786812:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834816 00000100:00100000:0.0:1790656604.786880:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1790656604.786892:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+11:11584:x1877639248834816:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656604.786924:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656604.786949:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a80 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.786991:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 12 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.787002:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656604.787007:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656604.787014:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.787054:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 12 pid: 8825 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.787080:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 12 pid: 8825 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656604.787098:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269787136:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656604.787352:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc900 going to sleep for 11 seconds 00000100:00100000:1.0:1790656604.791423:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656604.791764:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1877639269787136:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656604.791814:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656604.791840:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506a00, rc 0) 00000100:00100000:2.0:1790656604.792095:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248834944 00000100:00100000:2.0:1790656604.792104:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248834944 00010000:00010000:2.0:1790656604.792151:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 13 pid: 8825 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656604.792216:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:2.0:1790656604.792226:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+13:2341:x1877639248834944:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656604.792255:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656604.792284:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 13 pid: 8825 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.792298:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 13 pid: 8825 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.792327:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c355e08/0x9c3a6e82066eba1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a79 expref: 13 pid: 8825 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.792347:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656604.792352:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790656604.792372:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.792383:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.792438:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656604.792454:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269787264:192.168.203.23@tcp:105: 00000100:00100000:0.0:1790656604.792844:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:177b5748-b800-471f-9375-621ebde8193b+12:11584:x1877639248834816:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 5952us (6614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.792854:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:2.0:1790656604.793122:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656604.800586:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.800987:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1877639269787264:192.168.203.23@tcp:105: 00010000:00010000:3.0:1790656604.801020:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656604.801107:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+11:2341:x1877639248834944:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 8880us (9709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656604.801120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:1.0:1790656604.801312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835072 00000100:00100000:1.0:1790656604.801321:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835072 00002000:00100000:1.0:1790656604.801377:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94393fbc9880 x1877639248835072/t0(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:465/0 lens 504/0 e 0 to 0 dl 1790656615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790656604.801391:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fbc9880 with x1877639248835072 ext(0->12) 00002000:00010000:1.0:1790656604.801397:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393fbc9880 00000100:00100000:1.0:1790656604.801430:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1790656604.801440:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+11:2341:x1877639248835072:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790656604.805789:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:177b5748-b800-471f-9375-621ebde8193b+13:2341:x1877639248835072:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 4333us (5199us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790656604.805837:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00002000:00100000:3.0:1790656604.805858:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94393fbc9880 x1877639248835072/t4294967320(0) o4->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:465/0 lens 504/448 e 0 to 0 dl 1790656615 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656604.805869:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393fbc9880 with x1877639248835072 ext(0->12) 00002000:00010000:3.0:1790656604.805877:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393fbc9880 00000100:00100000:2.0:1790656604.810943:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.811044:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835200 00000100:00100000:1.0:1790656604.811057:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835200 00000100:00100000:1.0:1790656604.811137:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:1.0:1790656604.811299:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+66:11584:x1877639248835200:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790656604.865709:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1790656604.865726:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1790656604.865761:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790656604.865785:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9439287fc000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790656604.865790:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94390966a900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9439287fc600 00000020:00080000:2.0:1790656604.865794:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94390966a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94393fbdb400 00000004:00080000:2.0:1790656604.865850:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1790656604.865871:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943928554c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790656604.865874:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943928554cc0 00000020:00080000:2.0:1790656604.865877:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943902c05c00 00000001:00080000:2.0:1790656604.865891:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1790656604.865929:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1790656604.866404:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+20:11584:x1877639248835200:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 55101us (55469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656604.866418:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:0.0:1790656604.866478:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656604.866497:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269787392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790656604.866830:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656604.866840:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943803249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269787520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790656604.866917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656604.866996:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269787648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790656604.867019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656604.867065:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269787520 00000100:00100000:0.0:1790656604.869860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1790656604.870379:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790656604.870814:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269787648 00000100:00100000:3.0:1790656604.870826:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269787648 00000100:00100000:3.0:1790656604.870903:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269787392 00000100:00100000:3.0:1790656604.870907:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269787392 00000100:00100000:3.0:1790656604.870930:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790656604.870940:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269787648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790656604.871266:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269787520 00000100:00100000:1.0:1790656604.871293:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790656604.871301:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1877639269787392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790656604.871320:0:8825:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1790656604.871360:0:8825:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abb405a, atime: 0x6abb405a, ctime: 0x6abb405a, blocks: 0x1 00010000:00010000:1.0:1790656604.871371:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.871391:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1790656604.871396:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656604.871404:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.871434:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.871446:0:8825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.871472:0:8825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.871496:0:8825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1790656604.871688:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656604.871694:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1790656604.872990:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790656604.872999:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790656604 00002000:00010000:3.0:1790656604.873002:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790656604.873005:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790656603 -> 1790656604 00002000:00010000:3.0:1790656604.873007:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790656604.873765:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.874355:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1877639269787392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3050us (6815us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790656604.874368:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790656604.874404:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835328 00000100:00100000:1.0:1790656604.874413:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835328 00000100:00100000:1.0:1790656604.874479:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790656604.874489:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1877639269787520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790656604.874524:0:8825:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1790656604.874763:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.874789:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 13 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.874799:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1790656604.874804:0:8825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656604.874809:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.874851:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 13 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.874887:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 13 pid: 8825 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.874903:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8825:1877639269787776:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656604.874999:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94180 going to sleep for 11 seconds 00010000:00010000:1.0:1790656604.875024:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656604.875032:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.875042:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f07e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656604.875047:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.875060:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.875083:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.875093:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000464e26ee/0x9c3a6e82066eba2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.875119:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656604.875121:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656604.875129:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790656604.876394:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943935266680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1790656604.876410:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269787392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790656604.879010:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.879061:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835456 00000100:00100000:1.0:1790656604.879079:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835456 00010000:00010000:1.0:1790656604.879132:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 14 pid: 8825 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.879176:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:1.0:1790656604.879188:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+14:2341:x1877639248835456:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656604.879206:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656604.879212:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 14 pid: 8825 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.879226:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 14 pid: 8825 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.879269:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656604.879274:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656604.879280:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.879291:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.879316:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656604.879378:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:177b5748-b800-471f-9375-621ebde8193b+14:2341:x1877639248835456:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 193us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656604.879408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:2.0:1790656604.880061:0:8825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ee13e0/0x9c3a6e82066eb7ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379df expref: 13 pid: 8825 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656604.880090:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8825:1877639269787776:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656604.880117:0:8825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.880128:0:8825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.880135:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.880146:0:8825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.880155:0:8825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.880182:0:8825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656604.881933:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656604.881950:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.881965:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656604.881971:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.881984:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.882009:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.882018:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066eba32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.882342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656604.882345:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656604.882347:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790656604.882744:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943803249f80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790656604.882757:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943803249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269787520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790656604.882869:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3299:x1877639269787520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8380us (15949us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790656604.882882:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790656604.882939:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1790656604.882958:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+12:2339:x1877639248835328:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790656604.883454:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1877639269787648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 12512us (16431us total) trans 4294967321 rc 0/0 00000004:00080000:1.0:1790656604.883733:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94393b6ec700/2, rc 0, transno 4294967321 00000100:00100000:1.0:1790656604.883740:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269787648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790656604.883802:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1790656604.895139:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790656604.945264:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1790656604.945296:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1790656604.945305:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1790656604.945818:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2339:x1877639248835328:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 62861us (72052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656604.945851:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1790656604.955990:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.957326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835712 00000100:00100000:1.0:1790656604.957346:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835712 00000100:00100000:1.0:1790656604.957783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:1.0:1790656604.957797:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+20:11584:x1877639248835712:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790656604.957869:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656604.957903:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34e00/0x9c3a6e82066eba16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a72 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.957932:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:1.0:1790656604.957937:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656604.957974:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.957991:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656604.958002:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790656604.958372:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065204ae9 reply state 000000002db9d9c4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656604.958383:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790656604.958529:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+21:11584:x1877639248835712:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 735us (2556us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790656604.958547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:3.0:1790656604.978672:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656604.978872:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248835840 00000100:00100000:1.0:1790656604.978888:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248835840 00000100:00100000:1.0:1790656604.978969:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:1.0:1790656604.978982:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248835840:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790656604.979322:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790656604.979345:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790656604 -> 1790656603 00002000:00010000:1.0:1790656604.979347:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790656602 00002000:00010000:1.0:1790656604.979349:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790656604 -> 1790656603 00002000:00010000:1.0:1790656604.979352:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790656604.979439:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248835840:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 458us (783us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790656604.979448:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00010000:00010000:2.0:1790656604.980226:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980248:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980257:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980265:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f07400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656604.980271:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980281:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980310:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:2.0:1790656604.980313:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656604.980319:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656604.980326:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07400/0x9c3a6e82066eba39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656604.990075:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656604.990228:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836096 00000100:00100000:3.0:1790656604.990247:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836096 00000100:00100000:3.0:1790656604.990318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 228 00000100:00100000:3.0:1790656604.990337:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+20:11584:x1877639248836096:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790656604.990407:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.990449:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.990460:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.990498:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656604.990513:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 20 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656604.990528:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269787904:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656604.990676:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38840 going to sleep for 11 seconds 00000100:00100000:0.0:1790656605.004284:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269787904:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656605.004334:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.007138:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656605.007254:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836224 00000100:00100000:3.0:1790656605.007271:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836224 00010000:00010000:3.0:1790656605.007335:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656605.007385:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:3.0:1790656605.007396:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+21:2342:x1877639248836224:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656605.007414:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656605.007423:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007439:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007495:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07a00/0x9c3a6e82066eb9fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a64 expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007656:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:3.0:1790656605.007664:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007677:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007687:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.007727:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656605.007804:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+20:2342:x1877639248836224:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 409us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656605.007812:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00010000:00010000:0.0:1790656605.008323:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008350:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008389:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008396:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008405:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008411:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656605.008417:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008426:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008437:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:0.0:1790656605.008440:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790656605.008444:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.008451:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.009038:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+19:11584:x1877639248836096:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 18183us (18445us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790656605.009054:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 228 00000100:00100000:0.0:1790656605.017874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656605.017961:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836352 00000100:00100000:3.0:1790656605.017982:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836352 00000100:00100000:3.0:1790656605.018076:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1790656605.018089:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248836352:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790656605.018155:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.018412:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.018452:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790656605.018457:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656605.018463:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.018517:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.018536:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 8 pid: 6690 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656605.018555:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1877639269788032:192.168.203.23@tcp:104: 00000100:00100000:3.0:1790656605.018748:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908e38cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656605.021823:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1877639269788032:192.168.203.23@tcp:104: 00010000:00010000:3.0:1790656605.021867:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.024994:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656605.027812:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836480 00000100:00100000:1.0:1790656605.027838:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836480 00010000:00010000:2.0:1790656605.028281:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 9 pid: 6690 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.028367:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:2.0:1790656605.028380:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+9:2341:x1877639248836480:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656605.028402:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656605.028444:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 9 pid: 6690 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.028461:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 9 pid: 6690 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.028492:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063420f71/0x9c3a6e82066eba24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a80 expref: 9 pid: 6690 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.028515:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656605.028520:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790656605.028527:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.028693:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.028857:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656605.028944:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248836480:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 566us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656605.028953:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00010000:00010000:0.0:1790656605.035060:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035088:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035142:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035152:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035163:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035171:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656605.035176:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035187:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035225:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.035274:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066eba47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.036711:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+7:2341:x1877639248836352:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 18606us (18830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656605.036729:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1790656605.042890:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656605.043005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836736 00000100:00100000:2.0:1790656605.043019:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836736 00000100:00100000:2.0:1790656605.043141:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:2.0:1790656605.043155:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+19:11584:x1877639248836736:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790656605.043287:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043311:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043326:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043871:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043890:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043900:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043947:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.043965:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 20 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.043983:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269788160:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656605.044146:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106000 going to sleep for 11 seconds 00000100:00100000:2.0:1790656605.048579:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656605.048720:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836864 00000100:00100000:3.0:1790656605.048733:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836864 00010000:00010000:3.0:1790656605.048786:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656605.048845:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:3.0:1790656605.048857:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+21:2342:x1877639248836864:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656605.048906:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656605.048915:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.048930:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 21 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.048960:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:3.0:1790656605.048966:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.048977:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.048986:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.049011:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656605.049085:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:177b5748-b800-471f-9375-621ebde8193b+21:2342:x1877639248836864:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 229us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656605.049093:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00010000:00010000:0.0:1790656605.053686:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07c00/0x9c3a6e82066eba08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a6b expref: 20 pid: 6714 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.053725:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269788160:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656605.053761:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.053776:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.053783:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656605.055644:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790656605.055840:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790656605.055891:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790656605.056007:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269788288:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790656605.056124:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656605.056184:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287fc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656605.056310:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269788288 00000100:00100000:1.0:1790656605.056319:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269788288 00000100:00100000:1.0:1790656605.056386:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790656605.056397:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269788288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790656605.056510:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269788288:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656605.056518:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656605.056718:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1790656605.056726:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1790656605.056748:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94393b6ec700, transno 4294967321 00000004:00080000:2.0:1790656605.056768:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943803249f80, transno 4294967322 00000100:00100000:2.0:1790656605.056777:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269788288:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790656605.057348:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790656605.058190:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269788416:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790656605.058265:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656605.058306:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439031060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656605.058811:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269788416 00000100:00100000:1.0:1790656605.058822:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269788416 00000100:00100000:1.0:1790656605.058876:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790656605.058887:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1877639269788416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790656605.059170:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1877639269788416:12345-0@lo:1000:mdt00_000.0 Request processed in 284us (903us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790656605.059179:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656605.059490:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1877639269788416:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790656605.059555:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059570:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059578:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059585:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656605.059616:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059625:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059644:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439148d8c00) 00010000:00010000:2.0:1790656605.059647:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656605.059675:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059684:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481e00/0x9c3a6e82066eba55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059723:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059729:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059735:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656605.059742:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059748:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059757:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656605.059760:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656605.059768:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.059781:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.060091:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.060151:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.060167:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269788544:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656605.060734:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439031060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656605.084446:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656605.084705:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248836992 00000100:00100000:3.0:1790656605.084719:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248836992 00000100:00100000:3.0:1790656605.084797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:3.0:1790656605.084816:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+24:11582:x1877639248836992:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:3.0:1790656605.084993:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+24:11582:x1877639248836992:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 178us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656605.085001:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1790656605.091539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656605.091752:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248837248 00000100:00100000:2.0:1790656605.091765:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248837248 00000100:00100000:2.0:1790656605.091844:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:2.0:1790656605.091857:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+24:11582:x1877639248837248:12345-192.168.203.23@tcp:58:lfs.0 00000040:00080000:2.0:1790656605.092395:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790656605.092512:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+24:11582:x1877639248837248:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 656us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656605.092521:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:0.0:1790656605.097314:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1877639269788544:192.168.203.23@tcp:105: 00010000:00010000:0.0:1790656605.097383:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097396:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35a00/0x9c3a6e82066eb998 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097450:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097468:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097483:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097496:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097502:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097509:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097515:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656605.097520:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097528:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097552:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656605.097555:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656605.097569:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097575:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507800/0x9c3a6e82066eba5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097587:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097644:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097650:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097656:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656605.097659:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097665:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097674:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:0.0:1790656605.097677:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656605.097680:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656605.097686:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066eba4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.101797:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:177b5748-b800-471f-9375-621ebde8193b+23:11584:x1877639248836736:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 58628us (58904us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1790656605.101817:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 229 00000020:00080000:0.0:1790656605.101843:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790656605.102727:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656605.102735:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656605.102781:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790656605.102799:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790656605.102957:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269788672:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790656605.103052:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656605.127476:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656605.127680:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248837504 00000100:00100000:3.0:1790656605.127694:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248837504 00000100:00100000:3.0:1790656605.127778:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1790656605.127790:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390737e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+24:11584:x1877639248837504:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790656605.128691:0:5846:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790656605.128817:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1790656605.128883:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128903:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128918:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128928:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128935:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128940:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656605.128975:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790656605.129109:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390737e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+26:11584:x1877639248837504:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1316us (1643us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1790656605.129120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000020:00080000:3.0:1790656605.129127:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790656605.129523:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656605.129542:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.129552:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656605.129557:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.129568:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.129586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9439086c3900) 00010000:00010000:2.0:1790656605.129638:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790656605.129646:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.129653:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be35e00/0x9c3a6e82066eba63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.129678:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656605.129680:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656605.129682:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656605.130390:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877639269788672:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790656605.132961:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656605.133066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248837632 00000100:00100000:1.0:1790656605.133078:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248837632 00000100:00100000:1.0:1790656605.133150:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:1.0:1790656605.133162:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+25:11585:x1877639248837632:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790656605.133209:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790656605.133376:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+25:11585:x1877639248837632:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 216us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656605.133384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:2.0:1790656605.142422:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656605.142546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248837760 00000100:00100000:1.0:1790656605.142559:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248837760 00000100:00100000:1.0:1790656605.142663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:1.0:1790656605.142677:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+25:11587:x1877639248837760:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656605.142707:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656605.142738:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06400/0x9c3a6e82066eba6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a87 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142839:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142871:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142910:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142919:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.142926:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.143228:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.143255:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.143265:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.143311:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.143329:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 26 pid: 5845 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656605.143346:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269788800:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656605.143468:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94480 going to sleep for 11 seconds 00000100:00100000:3.0:1790656605.148284:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656605.148383:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248838016 00000100:00100000:1.0:1790656605.148397:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248838016 00000100:00100000:1.0:1790656605.148484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:1.0:1790656605.148516:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+27:11585:x1877639248838016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656605.148868:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656605.148916:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06200/0x9c3a6e82066eba86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a8e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149058:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07600/0x9c3a6e82066eba8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149078:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07600/0x9c3a6e82066eba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149092:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07600/0x9c3a6e82066eba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656605.149107:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790656605.149292:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06200/0x9c3a6e82066eba86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a8e expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149313:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07600/0x9c3a6e82066eba8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a8e expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149323:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656605.149327:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790656605.149330:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149339:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656605.149347:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07600, rc 0) 00000100:00100000:1.0:1790656605.149449:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+29:11585:x1877639248838016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 935us (1180us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1790656605.149458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:2.0:1790656605.154336:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656605.154384:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656605.154428:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248838528 00000100:00100000:2.0:1790656605.154440:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248838528 00000100:00100000:2.0:1790656605.154515:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:2.0:1790656605.154529:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+29:11585:x1877639248838528:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790656605.154680:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1877639269788800:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656605.154718:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656605.155325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248838272 00000100:00100000:0.0:1790656605.155336:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248838272 00000100:00100000:0.0:1790656605.155397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1790656605.155408:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+30:5581:x1877639248838272:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790656605.155800:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+31:5581:x1877639248838272:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 392us (1475us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1790656605.155809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00010000:00010000:2.0:1790656605.157786:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.157810:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.157825:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.158848:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.158865:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159157:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159166:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656605.159172:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159183:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159203:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656605.159206:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790656605.159213:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159220:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066eba9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.159474:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+31:11585:x1877639248838528:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 4940us (5081us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790656605.159487:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:2.0:1790656605.159636:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656605.159775:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248838656 00000100:00100000:2.0:1790656605.159785:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248838656 00010000:00010000:2.0:1790656605.159823:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 31 pid: 5845 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656605.159855:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:2.0:1790656605.159866:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+31:2340:x1877639248838656:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656605.159894:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656605.159901:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 31 pid: 5845 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159914:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 31 pid: 5845 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159932:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07000/0x9c3a6e82066eb98a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a48 expref: 31 pid: 5845 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159945:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656605.159949:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159959:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159966:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.159994:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656605.160024:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:177b5748-b800-471f-9375-621ebde8193b+30:2340:x1877639248838656:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 159us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656605.160031:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00010000:00010000:2.0:1790656605.160059:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160067:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656605.160120:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790656605.160126:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656605.160151:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160164:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160175:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160181:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160188:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160193:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f07e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656605.160196:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160202:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160211:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:2.0:1790656605.160214:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656605.160217:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160222:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07e00/0x9c3a6e82066eba71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160258:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160265:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160271:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160277:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f07800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656605.160280:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160285:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160294:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9439148d8a00) 00010000:00010000:2.0:1790656605.160296:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656605.160300:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160306:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07800/0x9c3a6e82066eba78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160349:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06400/0x9c3a6e82066eba6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a87 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160366:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a87 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656605.160387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:2.0:1790656605.160390:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790656605.160392:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06800, rc 0) 00000100:00100000:2.0:1790656605.160420:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+29:11587:x1877639248837760:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 17747us (18021us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656605.160427:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 232 00000040:00080000:1.0:1790656605.160885:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656605.160891:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656605.161389:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790656605.161403:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790656605.169339:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656605.169438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248838912 00000100:00100000:0.0:1790656605.169454:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248838912 00000100:00100000:0.0:1790656605.169538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1790656605.169551:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+29:11585:x1877639248838912:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790656605.170300:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+30:11585:x1877639248838912:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 746us (974us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790656605.170311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000001:00080000:3.0:1790656605.424945:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1790656605.424986:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1790656605.425001:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1790656605.922752:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790656606.114174:0:12512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790656606.114203:0:12512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790656606.114268:0:12512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790656606.114275:0:12512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790656606.393250:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656606.393348:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839168 00000100:00100000:1.0:1790656606.393365:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839168 00000100:00100000:1.0:1790656606.393484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:1.0:1790656606.393498:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+30:11610:x1877639248839168:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656606.393545:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656606.393579:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06200/0x9c3a6e82066ebaa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a95 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.393746:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06a00/0x9c3a6e82066ebaa9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.393766:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06a00/0x9c3a6e82066ebaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.393780:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06a00/0x9c3a6e82066ebaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656606.393816:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790656606.394007:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06200/0x9c3a6e82066ebaa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a95 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.394043:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06a00/0x9c3a6e82066ebaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a95 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.394052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656606.394055:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790656606.394060:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06a00, rc 0) 00000100:00100000:1.0:1790656606.394139:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+32:11610:x1877639248839168:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 644us (917us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790656606.394147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00080000:0.0:1790656606.394656:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656606.411290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656606.412562:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839296 00000100:00100000:1.0:1790656606.412578:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839296 00000100:00100000:1.0:1790656606.412667:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1790656606.412679:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+32:11610:x1877639248839296:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1790656606.412772:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412794:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412809:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412844:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412861:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412869:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412876:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656606.412881:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412891:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412906:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656606.412909:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656606.412915:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.412922:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656606.413024:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:177b5748-b800-471f-9375-621ebde8193b+32:11610:x1877639248839296:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 333us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656606.413033:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:2.0:1790656606.553669:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656606.553865:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839424 00000100:00100000:1.0:1790656606.553876:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839424 00000100:00100000:1.0:1790656606.553943:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:1.0:1790656606.553954:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248839424:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:1.0:1790656606.553971:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656606.554010:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066ebabe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237a9c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790656606.554044:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abb405b, atime: 0x6abb405a, ctime: 0x6abb405b, blocks: 0xb 00010000:00010000:1.0:1790656606.554064:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1790656606.554069:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656606.554077:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066ebabe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a9c expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.554093:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066ebabe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a9c expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656606.554105:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06400, rc 0) 00000100:00100000:1.0:1790656606.554169:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+8:2342:x1877639248839424:12345-192.168.203.23@tcp:101:cat.0 Request processed in 218us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656606.554176:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00080000:0.0:1790656606.554370:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656606.571323:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656606.571466:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839552 00000100:00100000:3.0:1790656606.571481:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839552 00002000:00100000:3.0:1790656606.571561:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94393bea6300 x1877639248839552/t0(0) o3->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:467/0 lens 488/0 e 0 to 0 dl 1790656617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656606.571574:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393bea6300 with x1877639248839552 ext(0->4095) 00002000:00010000:3.0:1790656606.571581:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393bea6300 00000100:00100000:3.0:1790656606.571682:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1790656606.571694:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248839552:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:3.0:1790656606.572465:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:177b5748-b800-471f-9375-621ebde8193b+8:2341:x1877639248839552:12345-192.168.203.23@tcp:3:cat.0 Request processed in 768us (1153us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790656606.572475:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00002000:00100000:3.0:1790656606.572485:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94393bea6300 x1877639248839552/t0(0) o3->177b5748-b800-471f-9375-621ebde8193b@192.168.203.23@tcp:467/0 lens 488/4536 e 0 to 0 dl 1790656617 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790656606.572495:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94393bea6300 with x1877639248839552 ext(0->4095) 00002000:00010000:3.0:1790656606.572501:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94393bea6300 00010000:00010000:2.0:1790656606.943300:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656607.390974:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269789056:0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.391106:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94392da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269788928:0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.391190:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656607.391332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656607.391389:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269789568:0@lo:400:kworker.0 00000100:00100000:0.0:1790656607.391611:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269789312:0@lo:400:kworker.0 00000100:00100000:0.0:1790656607.391656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656607.391703:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789312 00000100:00100000:2.0:1790656607.391714:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789312 00000100:00100000:0.0:1790656607.391755:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269788928 00000100:00100000:0.0:1790656607.391759:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269788928 00000100:00100000:0.0:1790656607.391805:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790656607.391815:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269788928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656607.392016:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3302:x1877639269788928:12345-0@lo:400:kworker.0 Request processed in 200us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656607.392035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790656607.392127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656607.392333:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269788928:0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.392344:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269789440:0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.392371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656607.392430:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789056 00000100:00100000:1.0:1790656607.392435:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789056 00000100:00100000:1.0:1790656607.392467:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789440 00000100:00100000:1.0:1790656607.392470:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789440 00000100:00100000:1.0:1790656607.392506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790656607.392514:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269789056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.392553:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269789056:12345-0@lo:400:kworker.0 Request processed in 40us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656607.392560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790656607.392573:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790656607.392579:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269789440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.392626:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877639269789440:12345-0@lo:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656607.392633:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790656607.392679:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1877639269789440:0@lo:400:kworker.0 00000100:00100000:3.0:1790656607.392933:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94392da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269789056:0@lo:400:kworker.0 00000100:00100000:3.0:1790656607.392946:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790656607.392952:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393fbced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269789184:0@lo:400:kworker.0 00000100:00100000:3.0:1790656607.392991:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656607.393023:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269789696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656607.393048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656607.393083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789184 00000100:00100000:3.0:1790656607.393088:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789184 00000100:00100000:3.0:1790656607.393118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790656607.393125:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269789184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656607.393160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269789184:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656607.393166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790656607.393186:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789696 00000100:00100000:3.0:1790656607.393190:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789696 00000100:00100000:3.0:1790656607.393229:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790656607.393237:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269789696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790656607.393272:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656607.393303:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269789696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656607.393310:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790656607.393339:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269789184:0@lo:400:kworker.0 00000100:00100000:3.0:1790656607.393348:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1790656607.393354:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1790656607.393378:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943935266680, transno 4294967310 00000100:00100000:3.0:1790656607.393397:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269789696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656607.401352:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789568 00000100:00100000:0.0:1790656607.401375:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789568 00000100:00100000:1.0:1790656607.401692:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790656607.401707:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943909790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269789312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.401852:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943909790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269789312:12345-0@lo:400:kworker.0 Request processed in 148us (10194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656607.401860:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790656607.402208:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269789312:0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.402267:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790656607.402275:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269789568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656607.402319:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269789568:12345-0@lo:400:kworker.0 Request processed in 45us (10192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656607.402326:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790656607.402356:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269789568:0@lo:400:kworker.0 00000100:00080000:2.0:1790656607.402753:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656607.402846:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790656607.402851:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656607.966795:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656608.928260:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656608.928351:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656608.929286:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789824 00000100:00100000:3.0:1790656608.929300:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789824 00000100:00100000:3.0:1790656608.929376:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790656608.929401:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269789824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656608.929452:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656608.929529:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269789824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656608.929536:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790656608.929804:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269789824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656608.992904:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656609.026297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656609.027378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656609.027411:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656609.027431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656609.027460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656609.027497:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839936 00000100:00100000:3.0:1790656609.027509:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839936 00000100:00100000:3.0:1790656609.027574:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840064 00000100:00100000:3.0:1790656609.027577:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840064 00000100:00100000:3.0:1790656609.027621:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656609.027633:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2340:x1877639248839936:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656609.028169:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+8:2340:x1877639248839936:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 535us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656609.028179:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656609.028213:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1790656609.028223:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248840064:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656609.028254:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:177b5748-b800-471f-9375-621ebde8193b+5:2340:x1877639248840064:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656609.028261:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1790656609.028286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840192 00000100:00100000:3.0:1790656609.028299:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840192 00000100:00100000:3.0:1790656609.028334:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:3.0:1790656609.028341:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248840192:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656609.028370:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2340:x1877639248840192:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656609.028377:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:3.0:1790656609.028388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839808 00000100:00100000:3.0:1790656609.028391:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839808 00000100:00100000:3.0:1790656609.028414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:3.0:1790656609.028420:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:2340:x1877639248839808:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656609.028445:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+32:2340:x1877639248839808:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656609.028451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00080000:3.0:1790656609.028477:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656609.028483:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656609.028485:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656609.032272:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248839680 00000100:00100000:0.0:1790656609.032294:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248839680 00000100:00100000:0.0:1790656609.032425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 293 00000100:00100000:0.0:1790656609.032437:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248839680:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656609.032553:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2340:x1877639248839680:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 118us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656609.032562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 293 00010000:00010000:1.0:1790656610.016757:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790656610.033019:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1790656610.033037:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1790656610.073150:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1790656610.073208:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1790656610.073243:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943903106f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1790656610.073249:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943903106b40 00000020:00080000:1.0:1790656610.073254:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943928221c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94393b9e7000 00000020:00080000:1.0:1790656610.073280:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1790656610.073332:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1790656610.074000:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1790656611.039200:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656611.348963:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656611.349108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840320 00000100:00100000:1.0:1790656611.349118:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840320 00000100:00100000:1.0:1790656611.349204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:1.0:1790656611.349215:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+19:11263:x1877639248840320:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790656611.349325:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+19:11263:x1877639248840320:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656611.349333:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00080000:3.0:1790656611.349685:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656611.354772:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656611.354923:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840576 00000100:00100000:1.0:1790656611.354936:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840576 00000100:00100000:1.0:1790656611.355012:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1790656611.355025:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+19:11263:x1877639248840576:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790656611.355872:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+20:11263:x1877639248840576:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 843us (1107us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790656611.355882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00010000:00010000:1.0:1790656612.063755:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656612.511223:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269789952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656612.511333:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656612.511582:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269789952 00000100:00100000:0.0:1790656612.511612:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269789952 00000100:00100000:0.0:1790656612.511685:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790656612.511695:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943909732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269789952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656612.511732:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656612.511923:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269790208:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.511973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656612.512006:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656612.512014:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269790080:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656612.512125:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790208 00000100:00100000:2.0:1790656612.512132:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790208 00000100:00100000:2.0:1790656612.512174:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790656612.512194:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269790208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512241:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269790208:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656612.512248:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790656612.512298:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269790208:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512351:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269790336:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790656612.512405:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656612.512417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790336 00000100:00100000:2.0:1790656612.512420:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790336 00000100:00100000:2.0:1790656612.512446:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790656612.512453:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512499:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269790336:12345-0@lo:400:kworker.0 Request processed in 46us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656612.512506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1790656612.512522:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656612.512536:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269790336:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790080 00000100:00100000:2.0:1790656612.512563:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790080 00000100:00100000:2.0:1790656612.512612:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790656612.512619:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269790080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.512655:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3300:x1877639269790080:12345-0@lo:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656612.512669:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790656612.512707:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4906672e-e41b-4f99-9a3c-531aeecaa79a:3300:1877639269790080:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.517518:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269790592:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.517587:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656612.517810:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656612.517823:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269790464:0@lo:400:kworker.0 00000100:00100000:1.0:1790656612.523169:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656612.523286:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790592 00000100:00100000:1.0:1790656612.523297:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790592 00000100:00100000:1.0:1790656612.523363:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790656612.523374:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269790592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656612.523443:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269790592:12345-0@lo:400:kworker.0 Request processed in 70us (5855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656612.523450:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1790656612.523488:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656612.523505:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790464 00000100:00100000:1.0:1790656612.523509:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790464 00000100:00100000:1.0:1790656612.523540:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790656612.523546:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269790464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656612.523584:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269790464:12345-0@lo:400:kworker.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656612.523607:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1790656612.523621:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656612.523655:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1790656612.523661:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1790656612.523682:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269790464:0@lo:400:kworker.0 00000100:00100000:2.0:1790656612.525443:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269790592:0@lo:400:kworker.0 00000100:00100000:0.0:1790656612.530909:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943909732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269789952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19200us (19560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656612.530923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790656612.531207:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269789952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790656613.087907:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790656613.667484:0:12711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:36:51 (1790656611) 00000100:00100000:3.0:1790656614.048782:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790656614.048810:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269790720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790656614.048871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656614.048943:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790720 00000100:00100000:3.0:1790656614.048951:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790720 00000100:00100000:3.0:1790656614.048998:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790656614.049008:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269790720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656614.049038:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656614.049088:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269790720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656614.049095:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790656614.049145:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269790720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656614.049262:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656614.110837:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656614.140532:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656614.140574:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656614.140638:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656614.140662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656614.140685:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656614.140711:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840960 00000100:00100000:3.0:1790656614.140720:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840960 00000100:00100000:3.0:1790656614.140775:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248841088 00000100:00100000:3.0:1790656614.140778:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248841088 00000100:00100000:3.0:1790656614.140804:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1790656614.140816:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248840960:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656614.140883:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+7:2342:x1877639248840960:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656614.140891:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1790656614.140909:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1790656614.140916:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248841088:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656614.140951:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2342:x1877639248841088:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656614.140958:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1790656614.140977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248841216 00000100:00100000:3.0:1790656614.140980:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248841216 00000100:00100000:3.0:1790656614.141007:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840832 00000100:00100000:3.0:1790656614.141009:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840832 00000100:00100000:3.0:1790656614.141030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:3.0:1790656614.141037:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248841216:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656614.141135:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:2342:x1877639248841216:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 98us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656614.141141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:3.0:1790656614.141153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00100000:3.0:1790656614.141159:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+20:2342:x1877639248840832:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656614.141220:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:177b5748-b800-471f-9375-621ebde8193b+20:2342:x1877639248840832:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 47us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656614.141227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00080000:3.0:1790656614.141266:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790656614.141270:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790656614.141273:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790656614.141704:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248840704 00000100:00100000:2.0:1790656614.141710:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248840704 00000100:00100000:2.0:1790656614.141746:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 295 00000100:00100000:2.0:1790656614.141753:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248840704:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656614.141800:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2342:x1877639248840704:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 47us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656614.141823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 295 00000040:00080000:1.0:1790656614.367400:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656614.367409:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656614.372322:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1790656614.372336:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790656615.135673:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790656615.141776:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1790656615.141792:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790656615.142097:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790656615.142113:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790656616.161430:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656616.303278:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656616.303381:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248841344 00000100:00100000:2.0:1790656616.303391:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248841344 00000100:00100000:2.0:1790656616.303469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:2.0:1790656616.303480:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+5:12273:x1877639248841344:12345-192.168.203.23@tcp:101:lsof.0 00010000:00010000:2.0:1790656616.303500:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656616.303519:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ebac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237aa3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303581:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303661:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656616.303697:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656616.303701:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656616.303740:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ebac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237aa3 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303784:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237aa3 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656616.303792:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:2.0:1790656616.303795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790656616.303799:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481c00, rc 0) 00000100:00080000:3.0:1790656616.303963:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656616.304282:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+6:12273:x1877639248841344:12345-192.168.203.23@tcp:101:lsof.0 Request processed in 803us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656616.304289:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 238 00010000:00010000:1.0:1790656617.183065:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656617.635036:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269790848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656617.635117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635193:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269791360:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635256:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790656617.635263:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269790976:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635288:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635311:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269791488:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635375:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791360 00000100:00100000:0.0:1790656617.635383:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791360 00000100:00100000:0.0:1790656617.635431:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790656617.635441:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269791360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635492:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269791360:12345-0@lo:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.635499:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790656617.635519:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790848 00000100:00100000:0.0:1790656617.635523:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790848 00000100:00100000:0.0:1790656617.635545:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790656617.635551:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269790848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656617.635578:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656617.635633:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269790848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.635640:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790656617.635659:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269791104:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635680:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635697:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269791616:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635729:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656617.635734:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269791232:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635764:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656617.635791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791488 00000100:00100000:0.0:1790656617.635794:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791488 00000100:00100000:0.0:1790656617.635818:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791104 00000100:00100000:0.0:1790656617.635821:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791104 00000100:00100000:0.0:1790656617.635831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790656617.635836:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269791488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635864:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269791488:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.635870:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790656617.635878:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791232 00000100:00100000:0.0:1790656617.635880:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791232 00000100:00100000:0.0:1790656617.635894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790656617.635898:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269791104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635925:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269791104:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.635931:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790656617.635941:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790656617.635946:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269791232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.635968:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269791232:12345-0@lo:400:kworker.0 Request processed in 22us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.635974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790656617.636004:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269791232:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636014:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269791104:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636165:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269791488:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636190:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269790848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656617.636199:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269791360:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636242:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791616 00000100:00100000:0.0:1790656617.636246:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791616 00000100:00100000:0.0:1790656617.636266:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790656617.636272:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269791616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636304:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269791616:12345-0@lo:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.636310:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1790656617.636327:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790656617.636331:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656617.636333:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656617.636348:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269791616:0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269790976 00000100:00100000:0.0:1790656617.636380:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269790976 00000100:00100000:0.0:1790656617.636403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1790656617.636409:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269790976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656617.636445:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3301:x1877639269790976:12345-0@lo:400:kworker.0 Request processed in 36us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656617.636451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1790656617.636490:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269790976:0@lo:400:kworker.0 00000100:00100000:3.0:1790656618.071668:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656618.071871:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248841600 00000100:00100000:1.0:1790656618.071881:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248841600 00000100:00100000:1.0:1790656618.071955:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:1.0:1790656618.071965:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+19:12275:x1877639248841600:12345-192.168.203.23@tcp:35:umount.0 00000100:00080000:0.0:1790656618.072322:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656618.073631:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+20:12275:x1877639248841600:12345-192.168.203.23@tcp:35:umount.0 Request processed in 1659us (1964us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790656618.073642:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:3.0:1790656618.082712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656618.090208:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248841856 00000100:00100000:2.0:1790656618.090223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248841856 00000100:00100000:2.0:1790656618.090532:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:2.0:1790656618.090543:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+20:12275:x1877639248841856:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:2.0:1790656618.092187:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:177b5748-b800-471f-9375-621ebde8193b+21:12275:x1877639248841856:12345-192.168.203.23@tcp:35:umount.0 Request processed in 363us (8204us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1790656618.092202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1790656618.098654:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656618.100232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842112 00000100:00100000:1.0:1790656618.100246:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842112 00000100:00100000:1.0:1790656618.100519:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:1.0:1790656618.100530:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94390737d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+21:12275:x1877639248842112:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:1.0:1790656618.103879:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94390737d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+22:12275:x1877639248842112:12345-192.168.203.23@tcp:35:umount.0 Request processed in 3341us (5224us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790656618.103891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1790656618.114848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656618.114963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842368 00000100:00100000:2.0:1790656618.114974:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842368 00000100:00100000:2.0:1790656618.115034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1790656618.115043:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+22:12275:x1877639248842368:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:2.0:1790656618.115787:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:177b5748-b800-471f-9375-621ebde8193b+23:12275:x1877639248842368:12345-192.168.203.23@tcp:35:umount.0 Request processed in 740us (945us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790656618.115797:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1790656618.120705:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656618.120741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656618.120867:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842496 00000100:00100000:2.0:1790656618.120877:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842496 00000100:00100000:2.0:1790656618.120941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842624 00000100:00100000:2.0:1790656618.120944:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842624 00000100:00100000:2.0:1790656618.120962:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1790656618.120970:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+14:2341:x1877639248842496:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656618.120985:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656618.121004:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928480400/0x9c3a6e82066eab52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237635 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656618.121023:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656618.121071:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+13:2341:x1877639248842496:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656618.121078:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1790656618.121108:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1790656618.121115:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+12:2341:x1877639248842624:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656618.121123:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656618.121132:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439013fe400/0x9c3a6e82066eaab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2375fd expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656618.121169:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656618.122250:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2341:x1877639248842624:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1129us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656618.122260:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1790656618.125334:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656618.125510:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656618.125607:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842880 00000100:00100000:0.0:1790656618.125616:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842880 00000100:00100000:0.0:1790656618.125686:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1790656618.125696:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+5:2338:x1877639248842880:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:0.0:1790656618.125736:0:8825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eae2a 00000100:00080000:0.0:1790656618.125745:0:8825:0:(import.c:65:import_set_state_nolock()) ffff94393bc2d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790656618.125782:0:8825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790656618.126029:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:177b5748-b800-471f-9375-621ebde8193b+2:2338:x1877639248842880:12345-192.168.203.23@tcp:9:umount.0 Request processed in 333us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656618.126036:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00010000:00010000:0.0:1790656618.126056:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790656618.126196:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656618.139332:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248842752 00000100:00100000:1.0:1790656618.139357:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248842752 00000100:00100000:1.0:1790656618.139583:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656618.139627:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248843264 00000100:00100000:1.0:1790656618.139631:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248843264 00000100:00100000:3.0:1790656618.140408:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1790656618.140419:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2342:x1877639248842752:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656618.140435:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656618.140453:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cf400/0x9c3a6e82066ead4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237700 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656618.140468:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656618.140538:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2342:x1877639248842752:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 121us (15222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656618.140546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1790656618.141073:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:0.0:1790656618.141083:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+7:2338:x1877639248843264:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:0.0:1790656618.141110:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eb08b 00000020:00010000:0.0:1790656618.141118:0:6691:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94390783a000: total 0 00000100:00080000:0.0:1790656618.141123:0:6691:0:(import.c:65:import_set_state_nolock()) ffff943907839800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790656618.141175:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790656618.141417:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:177b5748-b800-471f-9375-621ebde8193b+5:2338:x1877639248843264:12345-192.168.203.23@tcp:9:umount.0 Request processed in 335us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656618.141424:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00080000:3.0:1790656618.141639:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1790656618.141726:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94390783a000: total 0 00010000:00010000:2.0:1790656618.141754:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94390783a000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790656618.141798:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079cc65c7/0x9c3a6e82066ebabe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a9c expref: 4 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656618.141829:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066eb42e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378d5 expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656618.141845:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94390783a000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790656618.141856:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656618.141858:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656618.141860:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656618.163721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656618.163782:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844288 00000100:00100000:0.0:1790656618.163796:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844288 00000100:00100000:0.0:1790656618.163920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:0.0:1790656618.163931:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+23:2338:x1877639248844288:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:0.0:1790656618.163966:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaac6 00000020:00010000:0.0:1790656618.163986:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9439353a2800: total 0 00000100:00080000:0.0:1790656618.163990:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9439353a5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790656618.164020:0:5845:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1790656618.164371:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:177b5748-b800-471f-9375-621ebde8193b+22:2338:x1877639248844288:12345-192.168.203.23@tcp:39:umount.0 Request processed in 441us (659us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790656618.164393:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 239 00000020:00010000:1.0:1790656618.164587:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9439353a2800: total 0 00010000:00010000:1.0:1790656618.164620:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656618.164664:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9439353a2800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1790656618.164703:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656618.164706:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790656618.164714:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506c00/0x9c3a6e82066eb419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ce expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164734:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:1.0:1790656618.164737:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790656618.164741:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066eae00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23772a expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164754:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:1.0:1790656618.164756:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656618.164760:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506000/0x9c3a6e82066eb482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378ea expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164772:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9439086c3600) 00010000:00010000:1.0:1790656618.164774:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790656618.164777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506800/0x9c3a6e82066eb0ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2377fc expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164791:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94391836df00) 00010000:00010000:1.0:1790656618.164794:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656618.164797:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507c00/0x9c3a6e82066ead90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23770e expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164811:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656618.164814:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656618.164818:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06800/0x9c3a6e82066eba7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a87 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164843:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656618.164845:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790656618.164849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96a00/0x9c3a6e82066eb77d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2379c3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164860:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656618.164862:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790656618.164865:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06a00/0x9c3a6e82066ebaa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a95 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164876:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656618.164879:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656618.164882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9439421cf600/0x9c3a6e82066eb30f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237888 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164895:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94391836dd00) 00010000:00010000:1.0:1790656618.164896:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656618.164900:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b507600/0x9c3a6e82066eb3ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378c0 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164914:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656618.164917:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656618.164921:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393be34a00/0x9c3a6e82066eb99f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a4f expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164932:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94391836d700) 00010000:00010000:1.0:1790656618.164934:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790656618.164944:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f07600/0x9c3a6e82066eba8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237a8e expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164962:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94391836d000) 00010000:00010000:1.0:1790656618.164964:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790656618.164968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94393b506600/0x9c3a6e82066eb49e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2378f1 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164981:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9439086c3700) 00010000:00010000:1.0:1790656618.164983:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656618.164986:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066eadac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237715 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656618.164999:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9439353a2800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1790656618.165016:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656618.165018:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656618.165020:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656618.207789:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656619.166857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269791744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656619.166926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656619.167122:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791744 00000100:00100000:3.0:1790656619.167141:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791744 00000100:00080000:0.0:1790656619.167246:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656619.167409:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790656619.167477:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269791744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656619.167514:0:6694:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656619.167569:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269791744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656619.167577:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790656619.167675:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269791744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790656619.230713:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656619.261528:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656619.261578:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656619.261709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844416 00000100:00100000:3.0:1790656619.261718:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844416 00000100:00100000:3.0:1790656619.261779:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 297 00000100:00100000:3.0:1790656619.261789:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248844416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656619.261869:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2339:x1877639248844416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656619.261876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 297 00000100:00100000:1.0:1790656619.262075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844544 00000100:00100000:1.0:1790656619.262080:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844544 00000100:00100000:1.0:1790656619.262144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1790656619.262153:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2339:x1877639248844544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656619.262187:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2339:x1877639248844544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656619.262193:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00080000:0.0:1790656619.262281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656620.271261:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790656620.274661:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000001:00080000:2.0:1790656620.274677:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1790656620.274694:0:5865:0:(genops.c:885:class_export_put()) final put ffff9439353a2800/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:1.0:1790656620.274752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9439353a2800/177b5748-b800-471f-9375-621ebde8193b for lustre-MDT0000 00000020:00000080:1.0:1790656620.274811:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9439353a5000 for lustre-MDT0000 00000001:00100000:0.0:1790656620.280206:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:0.0:1790656620.280215:0:6716:0:(genops.c:885:class_export_put()) final put ffff94390783a000/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:2.0:1790656620.280398:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94390783a000/177b5748-b800-471f-9375-621ebde8193b for lustre-OST0000 00000020:00000080:2.0:1790656620.280449:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943907839800 for lustre-OST0000 00000100:00100000:3.0:1790656620.361900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656620.361944:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656620.362027:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844800 00000100:00100000:1.0:1790656620.362048:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844800 00000100:00100000:1.0:1790656620.362104:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844672 00000100:00100000:1.0:1790656620.362107:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844672 00000100:00100000:1.0:1790656620.362137:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1790656620.362146:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+11:2340:x1877639248844800:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656620.362161:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656620.362179:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900031000/0x9c3a6e82066eab9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237674 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656620.362196:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656620.362264:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+10:2340:x1877639248844800:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 118us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656620.362272:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1790656620.362288:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1790656620.362295:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+9:2340:x1877639248844672:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656620.362303:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656620.362311:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481a00/0x9c3a6e82066eab98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23764a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656620.362320:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656620.362338:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:2340:x1877639248844672:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656620.362344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1790656620.366811:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656620.366910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248844928 00000100:00100000:1.0:1790656620.366922:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248844928 00000100:00100000:1.0:1790656620.367001:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1790656620.367014:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+8:2342:x1877639248844928:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656620.367058:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656620.367086:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928480c00/0x9c3a6e82066ead35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a2376f9 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656620.367108:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656620.367190:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+7:2342:x1877639248844928:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 180us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656620.367198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1790656620.391476:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656620.391629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845184 00000100:00100000:2.0:1790656620.391640:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845184 00000100:00100000:2.0:1790656620.391705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:2.0:1790656620.391716:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+6:2338:x1877639248845184:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:2.0:1790656620.391754:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eabad 00000020:00010000:2.0:1790656620.391763:0:5844:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94390a3a7800: total 0 00000100:00080000:2.0:1790656620.391768:0:5844:0:(import.c:65:import_set_state_nolock()) ffff94390a3a6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790656620.391794:0:5844:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1790656620.391866:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94390a3a7800: total 0 00010000:00010000:1.0:1790656620.391963:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94390a3a7800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790656620.392011:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94391836d400) 00010000:00010000:1.0:1790656620.392016:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656620.392030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481c00/0x9c3a6e82066ebacc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237aa3 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656620.392061:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94390a3a7800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790656620.392077:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656620.392080:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656620.392082:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656620.392691:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f328cd36-3190-45c6-abbe-cee7addf32ed+3:2338:x1877639248845184:12345-192.168.203.23@tcp:39:umount.0 Request processed in 877us (1125us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790656620.392702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:3.0:1790656620.421167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656620.421278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845440 00000100:00100000:0.0:1790656620.421292:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845440 00000100:00100000:0.0:1790656620.421362:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 298 00000100:00100000:0.0:1790656620.421373:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+7:2338:x1877639248845440:12345-192.168.203.23@tcp:251:umount.0 00000020:00000080:0.0:1790656620.421421:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaaa3 00000020:00010000:0.0:1790656620.421429:0:5837:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94391f585800: total 0 00000100:00080000:0.0:1790656620.421433:0:5837:0:(import.c:65:import_set_state_nolock()) ffff94391f586800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790656620.421512:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce46cfe8-c882-4ab6-90c2-4205ad1ab4df+3:2338:x1877639248845440:12345-192.168.203.23@tcp:251:umount.0 Request processed in 142us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656620.421519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 298 00000020:00010000:2.0:1790656620.421817:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94391f585800: total 0 00010000:00010000:2.0:1790656620.421821:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656620.421860:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94391f585800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790656620.421893:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c97a00/0x9c3a6e82066eab59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a23763c expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656620.421909:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94391f585800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790656620.421926:0:5831:0:(genops.c:885:class_export_put()) final put ffff94391f585800/ce46cfe8-c882-4ab6-90c2-4205ad1ab4df 00010000:00010000:2.0:1790656620.421948:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656620.421950:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656620.421952:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790656620.424351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94391f585800/ce46cfe8-c882-4ab6-90c2-4205ad1ab4df for MGS 00000020:00000080:0.0:1790656620.424410:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94391f586800 for MGS 00000001:00100000:2.0:1790656620.766988:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:2.0:1790656620.766998:0:7645:0:(genops.c:885:class_export_put()) final put ffff94393bc2a000/177b5748-b800-471f-9375-621ebde8193b 00000020:00000080:2.0:1790656620.767026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bc2a000/177b5748-b800-471f-9375-621ebde8193b for lustre-OST0001 00000020:00000080:2.0:1790656620.767072:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94393bc2d000 for lustre-OST0001 00010000:00010000:1.0:1790656621.284659:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790656622.164081:0:12911:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790656622.178494:0:12911:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790656622.178540:0:12911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.178553:0:12911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.178560:0:12911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.178584:0:12911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.178619:0:12911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790656622.178624:0:12911:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790656622.178650:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790656622.178655:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790656622.178660:0:12911:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790656622.178683:0:12911:0:(import.c:65:import_set_state_nolock()) ffff94393bfad000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790656622.178749:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269791872:0@lo:39:umount.0 00000100:00100000:3.0:1790656622.178807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656622.178913:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269791872 00000100:00100000:1.0:1790656622.178920:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269791872 00000100:00100000:1.0:1790656622.178964:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790656622.178973:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1877639269791872:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790656622.179005:0:5843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea8b2 00000100:00080000:1.0:1790656622.179013:0:5843:0:(import.c:65:import_set_state_nolock()) ffff94393bfc4000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790656622.179065:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3298:x1877639269791872:12345-0@lo:39:umount.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656622.179072:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790656622.179080:0:5843:0:(genops.c:885:class_export_put()) final put ffff94393bfc6000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1790656622.179099:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656622.179116:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.179124:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656622.179127:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.179146:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656622.179154:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656622.179159:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790656622.179162:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790656622.179164:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790656622.179184:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.179190:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656622.179213:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.179220:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066eab28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.179230:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.179232:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.179233:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790656622.179242:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfc6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790656622.179281:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94393bfc4000 for lustre-MDT0000 00000100:00080000:3.0:1790656622.179437:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393bfad000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790656622.179446:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269791872:0@lo:39:umount.0 00000100:00080000:1.0:1790656622.179486:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790656622.179489:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790656622.179493:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1790656622.181584:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269792000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656622.181712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656622.182290:0:12911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182321:0:12911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182329:0:12911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182336:0:12911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182351:0:12911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656622.182360:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656622.182366:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182372:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656622.182376:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182383:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656622.182390:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656622.182395:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790656622.182397:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790656622.182422:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182436:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656622.182461:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182467:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928481800/0x9c3a6e82066eab36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab3d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182476:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182477:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182479:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182489:0:12911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182495:0:12911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182501:0:12911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182508:0:12911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182518:0:12911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656622.182524:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656622.182527:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182532:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656622.182535:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182547:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656622.182554:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656622.182559:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790656622.182561:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790656622.182563:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790656622.182576:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182581:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656622.182615:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182622:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97400/0x9c3a6e82066eaa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eaa64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182634:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182636:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182637:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656622.182652:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269792256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656622.182708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656622.182756:0:12911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182764:0:12911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182779:0:12911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182785:0:12911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182795:0:12911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656622.182803:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656622.182807:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182814:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656622.182817:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182824:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656622.182830:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656622.182835:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790656622.182837:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790656622.182838:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790656622.182851:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182856:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656622.182865:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182876:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97600/0x9c3a6e82066ead5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.182885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.182889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656622.182899:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656622.182910:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269792384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656622.182940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656622.182982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792000 00000100:00100000:1.0:1790656622.182990:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792000 00000100:00100000:1.0:1790656622.183036:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792256 00000100:00100000:1.0:1790656622.183039:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792256 00000100:00100000:1.0:1790656622.183063:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792384 00000100:00100000:1.0:1790656622.183065:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792384 00000100:00100000:1.0:1790656622.183095:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1790656622.183161:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656622.183428:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+21:3301:x1877639269792000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656622.183445:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656622.183459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900031c00/0x9c3a6e82066eab2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066eab28 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.183471:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656622.183506:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269792128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656622.183507:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3301:x1877639269792000:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656622.183515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790656622.183537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656622.183546:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269792256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656622.183566:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656622.183578:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421ce200/0x9c3a6e82066eaa64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066eaa5d expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656622.183611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656622.183669:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790656622.183678:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790656622.183712:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269792000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656622.183808:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792128 00000100:00100000:3.0:1790656622.183815:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792128 00000100:00100000:3.0:1790656622.183891:0:12912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656622.183898:0:12912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94392867c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4906672e-e41b-4f99-9a3c-531aeecaa79a+20:3299:x1877639269792384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656622.183905:0:12912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656622.183914:0:12912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96e00/0x9c3a6e82066ead66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066ead5f expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656622.183922:0:12912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656622.183961:0:12912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94392867c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4906672e-e41b-4f99-9a3c-531aeecaa79a+19:3299:x1877639269792384:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656622.183967:0:12912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790656622.183994:0:12912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656622.184007:0:12912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4906672e-e41b-4f99-9a3c-531aeecaa79a+18:3302:x1877639269792128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656622.184015:0:12912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656622.184023:0:12912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c97e00/0x9c3a6e82066eab3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066eab36 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656622.184032:0:12912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656622.184076:0:12912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4906672e-e41b-4f99-9a3c-531aeecaa79a+17:3302:x1877639269792128:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656622.184084:0:12912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790656622.184121:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269792128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656622.184262:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656622.184351:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:3299:x1877639269792256:12345-0@lo:103:ldlm_bl.0 Request processed in 806us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656622.184357:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790656622.184413:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269792384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656622.184423:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269792256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656622.184451:0:12911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184460:0:12911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184466:0:12911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184473:0:12911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184485:0:12911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790656622.184489:0:12911:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790656622.184491:0:12911:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1790656622.184514:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656622.184519:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184535:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9439013ff800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656622.184538:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184545:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656622.184552:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656622.184557:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790656622.184560:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790656622.184561:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790656622.184576:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184582:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656622.184618:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013ff800/0x9c3a6e82066ea811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ea818 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.184636:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.184638:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656622.184640:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790656622.184652:0:12911:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790656622.184656:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790656622.184659:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790656622.184664:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1790656622.184673:0:12911:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94392dad8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790656622.184679:0:12911:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94393c8ab800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790656622.184685:0:12911:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff94390a3a7800 f328cd36-3190-45c6-abbe-cee7addf32ed 192.168.203.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790656622.184690:0:12911:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff94393bfb4d40) has exports, disconnecting them 00000020:00080000:1.0:1790656622.184694:0:12911:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94392dad8000), last request at 1790656617 00000020:00000080:1.0:1790656622.184700:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaa25 00000100:00080000:1.0:1790656622.184713:0:12911:0:(import.c:65:import_set_state_nolock()) ffff94392dada000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790656622.184747:0:12911:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94392dad8000): rc 0 00000020:00000080:1.0:1790656622.184750:0:12911:0:(genops.c:885:class_export_put()) final put ffff94392dad8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790656622.184757:0:12911:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94393c8ab800), last request at 1790656617 00000020:00000080:1.0:1790656622.184760:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea95a 00000100:00080000:1.0:1790656622.184765:0:12911:0:(import.c:65:import_set_state_nolock()) ffff9439072db000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790656622.184775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790656622.184781:0:12911:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94393c8ab800): rc 0 00000020:00000080:1.0:1790656622.184784:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393c8ab800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1790656622.184789:0:12911:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba9342dcbae0 00000100:00080000:1.0:1790656622.184806:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790656622.184810:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1790656622.184821:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790656622.184889:0:12911:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790656622.184900:0:12911:0:(import.c:65:import_set_state_nolock()) ffff943928640800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790656622.184909:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790656622.184911:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790656622.184917:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656622.185084:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269792640:0@lo:9:umount.0 00000100:00100000:3.0:1790656622.185129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790656622.186069:0:12911:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790656622.186086:0:12911:0:(import.c:65:import_set_state_nolock()) ffff94392dadc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790656622.186134:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94393bfb4d40) has no exports 00000100:00100000:3.0:1790656622.186324:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269792768:0@lo:9:umount.0 00000100:00100000:3.0:1790656622.186361:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656622.186991:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790656622.187006:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269792512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656622.187075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656622.187254:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792640 00000100:00100000:0.0:1790656622.187264:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792640 00000100:00100000:0.0:1790656622.187325:0:8825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792768 00000100:00100000:0.0:1790656622.187329:0:8825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792768 00000100:00100000:0.0:1790656622.187358:0:8825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790656622.187369:0:8825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1877639269792640:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790656622.187401:0:8825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea9ae 00000100:00080000:0.0:1790656622.187411:0:8825:0:(import.c:65:import_set_state_nolock()) ffff943925520000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790656622.187453:0:8825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790656622.187586:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792512 00000100:00100000:1.0:1790656622.187613:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792512 00000100:00100000:1.0:1790656622.187673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790656622.187688:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+15:3302:x1877639269792512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656622.187701:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656622.187719:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148d600/0x9c3a6e82066ea818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c3a6e82066ea811 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656622.187742:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656622.187808:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3302:x1877639269792512:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656622.187819:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1790656622.187966:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790656622.187981:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dad8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790656622.188040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393c8ab800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790656622.188094:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94392dada000 for lustre-MDT0000 00000020:00000080:2.0:1790656622.188102:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9439072db000 for lustre-MDT0000 00000100:00100000:2.0:1790656622.188156:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790656622.188169:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1877639269792768:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790656622.188187:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaa9c 00000100:00080000:2.0:1790656622.188196:0:6690:0:(import.c:65:import_set_state_nolock()) ffff94392dad9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790656622.188242:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1790656622.188521:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3298:x1877639269792768:12345-0@lo:9:umount.0 Request processed in 355us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656622.188528:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790656622.188585:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94392dadc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790656622.188625:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790656622.188627:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790656622.188631:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269792768:0@lo:9:umount.0 00010000:00010000:3.0:1790656622.189382:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790656622.189986:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790656622.189992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656622.193198:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656622.193342:0:8825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3298:x1877639269792640:12345-0@lo:9:umount.0 Request processed in 5964us (8201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656622.193359:0:8825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790656622.193434:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269792512:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790656622.199329:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943928640800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790656622.199363:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790656622.199366:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656622.199375:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269792640:0@lo:9:umount.0 00000020:00080000:2.0:1790656622.205836:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94393bfb4d40) has no exports 00000020:00000080:2.0:1790656622.243454:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea86c 00000020:00000080:2.0:1790656622.243469:0:12911:0:(genops.c:885:class_export_put()) final put ffff943935160800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790656622.243544:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1790656622.243641:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff943935160800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790656622.243755:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656622.243764:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790656622.243767:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff94393c898000) has no exports 00000020:00000080:3.0:1790656622.244123:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea865 00000020:00000080:3.0:1790656622.244129:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393c8a8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790656622.244230:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656622.244237:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790656622.244240:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393bfaa800/lustre-QMT0000_UUID 00000020:00000080:3.0:1790656622.244242:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfaa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1790656622.244249:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1790656622.244406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94393c8a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1790656622.302861:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656622.753557:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790656622.753578:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269793024:0@lo:400:kworker.0 00000100:00100000:1.0:1790656622.753668:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656622.753928:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656622.753940:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269792896:0@lo:400:kworker.0 00000100:00100000:2.0:1790656622.754110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656622.755341:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793024 00000100:00100000:1.0:1790656622.755352:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793024 00000100:00100000:1.0:1790656622.755408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269792896 00000100:00100000:1.0:1790656622.755412:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269792896 00000100:00100000:1.0:1790656622.755431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790656622.755438:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1877639269793024:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790656622.755447:0:5844:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790656622.755650:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790656622.755656:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877639269792896:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790656622.755662:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790656622.755700:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877639269792896:12345-0@lo:400:kworker.0 Request processed in 42us (1598us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790656622.755707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790656622.755803:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1877639269793024:12345-0@lo:400:kworker.0 Request processed in 364us (2135us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790656622.755810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1790656622.755899:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790656622.755904:0:3301:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790656622.755908:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790656622.761270:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790656622.761278:0:3300:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790656622.761283:0:3300:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790656622.761290:0:3300:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790656622.761294:0:3300:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 162 00000100:00080000:3.0:1790656622.761308:0:3300:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff943802669000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656622.761347:0:3300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bd3f480 x1877639269793152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790656622.761388:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269793024:0@lo:400:kworker.0 00000100:00100000:0.0:1790656622.761758:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269793152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1790656622.761818:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656622.762117:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793152 00000100:00100000:3.0:1790656622.762126:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793152 00000100:00100000:3.0:1790656622.762172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790656622.762179:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269793152:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1790656622.762194:0:5845:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1790656622.773013:0:3301:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656622.773039:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 144 00000100:00080000:2.0:1790656622.773055:0:3301:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94393c8ae000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656622.773112:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0e680 x1877639269793280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790656622.773144:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269792896:0@lo:400:kworker.0 00000100:00100000:0.0:1790656622.773183:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790656622.773401:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656622.773548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793280 00000100:00100000:1.0:1790656622.773562:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793280 00000100:00100000:1.0:1790656622.773617:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790656622.773624:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269793280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790656622.773638:0:5844:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790656622.778281:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269793280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4648us (4872us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790656622.778295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1790656622.778812:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790656622.778819:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790656622.778837:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790656622.815313:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269793152:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 53128us (53489us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790656622.815325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1790656622.815510:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790656622.815516:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790656622.815520:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269793152:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1790656623.326808:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656624.350869:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656625.375420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790656625.379909:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790656625.379918:0:6716:0:(genops.c:885:class_export_put()) final put ffff943925522000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790656625.380001:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff943925522000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790656625.380050:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943925520000 for lustre-OST0000 00000001:00100000:2.0:1790656625.386585:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f328cd36-3190-45c6-abbe-cee7addf32ed 00000001:00080000:2.0:1790656625.386637:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1790656625.386641:0:5865:0:(genops.c:885:class_export_put()) final put ffff94390a3a7800/f328cd36-3190-45c6-abbe-cee7addf32ed 00000020:00000080:1.0:1790656625.386727:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a3a7800/f328cd36-3190-45c6-abbe-cee7addf32ed for lustre-MDT0000 00000020:00000080:1.0:1790656625.386778:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94390a3a6000 for lustre-MDT0000 00000001:00100000:0.0:1790656625.872777:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790656625.872787:0:7645:0:(genops.c:885:class_export_put()) final put ffff94392dadf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790656625.872880:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dadf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790656625.873000:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94392dad9000 for lustre-OST0001 00010000:00010000:3.0:1790656626.399273:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656627.430513:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790656627.871170:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790656627.871175:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790656627.871178:0:38:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656627.871185:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 337 00000100:00080000:2.0:1790656627.871252:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790656627.871263:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94393c8ae000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656627.871286:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0f800 x1877639269793536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790656627.871350:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793536:0@lo:38:kworker.0 00000100:00100000:0.0:1790656627.871407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656627.871512:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790656627.871526:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269793408:0@lo:400:kworker.0 00000100:00100000:1.0:1790656627.871563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656627.871627:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793536 00000100:00100000:1.0:1790656627.871634:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793536 00000100:00100000:1.0:1790656627.871665:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790656627.871672:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3298:x1877639269793536:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1790656627.871687:0:6714:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1790656627.873307:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790656627.873315:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790656627.873333:0:38:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656627.873340:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 337 00000100:00080000:2.0:1790656627.873345:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790656627.873356:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff943802669000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656627.873387:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0d180 x1877639269793664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790656627.873481:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793408 00000100:00100000:3.0:1790656627.873489:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793408 00000100:00100000:3.0:1790656627.873538:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790656627.873547:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3299:x1877639269793408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656627.873636:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4906672e-e41b-4f99-9a3c-531aeecaa79a+14:3299:x1877639269793408:12345-0@lo:400:kworker.0 Request processed in 90us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656627.873644:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790656627.873694:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269793408:0@lo:400:kworker.0 00000100:00100000:0.0:1790656627.875142:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269793664:0@lo:38:kworker.0 00000100:00100000:0.0:1790656627.875202:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656627.875375:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269793664 00000100:00100000:3.0:1790656627.875382:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269793664 00000100:00100000:3.0:1790656627.875419:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790656627.875426:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269793664:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1790656627.875442:0:5844:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790656627.875481:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269793664:12345-0@lo:38:kworker.0 Request processed in 55us (278us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790656627.875499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1790656627.875655:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790656627.875661:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790656627.875664:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269793664:0@lo:38:kworker.0 00000100:00100000:1.0:1790656627.885223:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3298:x1877639269793536:12345-0@lo:38:kworker.0 Request processed in 13541us (13806us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790656627.885239:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1790656627.887073:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790656627.887084:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790656627.887089:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793536:0@lo:38:kworker.0 00000020:01000000:1.0:1790656628.318793:0:12911:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94393b6e5600 - data ffff94393fc61870/ffff94393bd3ac00 00000020:01000000:1.0:1790656628.318964:0:12911:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94392d903d20 - data ffff9439288825e8/ffff9439121a1400 00000001:00000004:1.0:1790656628.325022:0:12911:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1790656628.446899:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790656628.477225:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790656628.477234:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1790656628.477425:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656628.477429:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790656628.479229:0:6978:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790656628.479236:0:6978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1790656628.479255:0:6978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790656628.480358:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790656628.480363:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790656628.480388:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656628.480391:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790656628.480863:0:8022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790656628.480867:0:8022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790656628.480875:0:8022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790656628.591465:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea834 00000020:00000080:3.0:1790656628.591478:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393513f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790656628.591920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393513f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790656628.592463:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea849 00000020:00000080:3.0:1790656628.592469:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393bfc7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790656628.592511:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790656628.592520:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656628.592527:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790656628.592531:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff94393bfb3380) has no exports 00000004:01000000:3.0:1790656628.592706:0:12911:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790656628.592726:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaa87 00000020:00000080:3.0:1790656628.592730:0:12911:0:(genops.c:885:class_export_put()) final put ffff94392dad8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790656628.594352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfc7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790656628.596844:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790656628.596858:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656628.596872:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790656628.596876:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff94393c89cd40) has no exports 00000020:00000080:3.0:1790656628.596885:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaa80 00000020:00000080:1.0:1790656628.597019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dad8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790656628.597056:0:12911:0:(genops.c:885:class_export_put()) final put ffff94392dadc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790656628.599005:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dadc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790656628.600036:0:12911:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790656628.600041:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790656628.600045:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1790656628.600051:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656628.600053:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790656628.600107:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656628.600117:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656628.600124:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea9a0 00000020:00000080:3.0:1790656628.600132:0:12911:0:(genops.c:885:class_export_put()) final put ffff9439352c9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790656628.600137:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790656628.600144:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656628.600148:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790656628.600151:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff94393c9c3380) has no exports 00000020:00000080:3.0:1790656628.600156:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea999 00000020:00000080:3.0:1790656628.600159:0:12911:0:(genops.c:885:class_export_put()) final put ffff943928641800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1790656628.600470:0:12911:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790656628.600473:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790656628.600476:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1790656628.600479:0:12911:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790656628.600481:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790656628.600501:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656628.600505:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656628.600532:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656628.600535:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656628.600548:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393513a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790656628.600550:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff94393513a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790656628.600555:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656628.600722:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea850 00000020:00000080:3.0:1790656628.600726:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393bfc6800/lustre-MDD0000_UUID 00000020:01000000:3.0:1790656628.600729:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790656628.600733:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656628.600736:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790656628.600738:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff94393bfb0000) has no exports 00000020:00000080:3.0:1790656628.600757:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656628.600759:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790656628.600762:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea857 00000020:00000080:3.0:1790656628.600765:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393bfc5800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790656628.600770:0:12911:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943928721000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790656628.600773:0:12911:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943928721000 3 00000020:01000004:3.0:1790656628.600776:0:12911:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff943928721000 from lustre-MDT0000 00000020:00000080:3.0:1790656628.600791:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656628.600794:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790656628.600796:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393513c800/lustre-MDT0000_UUID 00000020:00000080:3.0:1790656628.600798:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff94393513c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790656628.600804:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1790656628.600924:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94392dadc800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790656628.600930:0:38:0:(genops.c:885:class_export_put()) final put ffff94392dad9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790656628.600933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dad9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790656628.600937:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790656628.600992:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9439352c9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790656628.600996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff943928641800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790656628.601000:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943928640800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790656628.601003:0:38:0:(genops.c:885:class_export_put()) final put ffff94393fb8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790656628.601005:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393fb8f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790656628.601011:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790656628.601056:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfc6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790656628.601070:0:38:0:(genops.c:885:class_export_put()) final put ffff94393513b000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790656628.601072:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393513b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790656628.601075:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790656628.601200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfc5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1790656628.601547:0:12911:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1790656628.601553:0:12911:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790656628.601556:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790656628.601560:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656628.601563:0:12911:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790656628.601568:0:12911:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff943932e6a800 4906672e-e41b-4f99-9a3c-531aeecaa79a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790656628.601574:0:12911:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff94392810b380) has exports, disconnecting them 00000020:00080000:3.0:1790656628.601578:0:12911:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff943932e6a800), last request at 1790656412 00000020:00000080:3.0:1790656628.604713:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea7f5 00000020:00010000:3.0:1790656628.604725:0:12911:0:(genops.c:1920:obd_stale_export_put()) Put export ffff943932e6a800: total 0 00000100:00080000:3.0:1790656628.604744:0:12911:0:(import.c:65:import_set_state_nolock()) ffff943932e6e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790656628.604811:0:12911:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff943932e6a800): rc 0 00000020:00080000:3.0:1790656628.604817:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff94392810b380) has no exports 00000100:00100000:0.0:1790656628.604972:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff943928338000:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1790656628.605313:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff94390b800c00:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1790656628.605368:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff94390f8e2000:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1790656628.605491:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605498:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605504:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605575:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605583:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605605:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605611:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605618:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605625:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605632:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605638:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605652:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605658:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605664:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605670:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605675:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605681:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605688:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605694:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605701:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605707:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605714:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605719:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605725:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605732:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605738:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605744:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605749:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605755:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605761:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605766:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605772:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605778:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605783:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605789:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605795:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605800:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605815:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605828:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605835:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605840:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605846:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605852:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605857:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605863:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.605868:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606006:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606011:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606018:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606024:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606030:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606035:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606041:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606046:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606053:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606068:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606075:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606080:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606085:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606091:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606097:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606103:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606109:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656628.606115:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790656628.606441:0:12911:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790656628.606445:0:12911:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1790656628.608635:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9439421cee00/0x9c3a6e82066ea90d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066ea906 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608659:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cee00/0x9c3a6e82066ea90d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066ea906 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608674:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff943907c96600/0x9c3a6e82066eaaf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066eaaf0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608681:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943907c96600/0x9c3a6e82066eaaf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066eaaf0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608688:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff94390148ce00/0x9c3a6e82066eab05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066eaafe expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608710:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94390148ce00/0x9c3a6e82066eab05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066eaafe expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608720:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff943928481600/0x9c3a6e82066eab13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066eab0c expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608728:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481600/0x9c3a6e82066eab13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066eab0c expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608736:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff943928480200/0x9c3a6e82066eab21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066eab1a expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608744:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928480200/0x9c3a6e82066eab21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066eab1a expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608752:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff943928481400/0x9c3a6e82066eab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066eab44 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608760:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481400/0x9c3a6e82066eab4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066eab44 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608772:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066ead3c expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608780:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9439421cf200/0x9c3a6e82066ead43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066ead3c expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608789:0:12911:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff94393b507a00/0x9c3a6e82066ead58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9c3a6e82066ead51 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656628.608819:0:12911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94393b507a00/0x9c3a6e82066ead58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9c3a6e82066ead51 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1790656628.609404:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff943932e6a800: total 0 00010000:00010000:1.0:1790656628.612726:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff943932e6a800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1790656628.612761:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff943932e6a800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1790656628.612776:0:5832:0:(genops.c:885:class_export_put()) final put ffff943932e6a800/4906672e-e41b-4f99-9a3c-531aeecaa79a 00010000:00010000:1.0:1790656628.612840:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656628.612854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656628.612858:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790656628.622914:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff943932e6a800/4906672e-e41b-4f99-9a3c-531aeecaa79a for MGS 00000020:00000080:1.0:1790656628.623179:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943932e6e000 for MGS 00010000:00010000:2.0:1790656629.470852:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656630.494715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790656630.622797:0:12911:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943909eac9c0 - data ffff94393fdf4948/ffff94392da88400 00000020:01000000:0.0:1790656630.622922:0:12911:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9439081d4ae0 - data ffff94392880d870/ffff943928487800 00000020:00000080:0.0:1790656630.623428:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea7d9 00000020:00000080:0.0:1790656630.623436:0:12911:0:(genops.c:885:class_export_put()) final put ffff94390a32e000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790656630.623458:0:12911:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943928721000 from MGS, refs=2 00000020:01000004:0.0:1790656630.623461:0:12911:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943928721000 2 00000020:01000004:0.0:1790656630.623464:0:12911:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff943928721000 from MGS 00000020:00000080:1.0:1790656630.623827:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a32e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790656630.623874:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790656630.623882:0:12911:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790656630.623884:0:12911:0:(genops.c:885:class_export_put()) final put ffff94390a32d800/MGS 00000020:00000080:0.0:1790656630.623887:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a32d800/MGS for MGS 00000020:01000000:0.0:1790656630.623893:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790656630.623946:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790656630.623950:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790656630.623955:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790656630.623961:0:12911:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94393c8aa000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790656630.623967:0:12911:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff94393bfb19c0) has exports, disconnecting them 00000020:00080000:0.0:1790656630.623971:0:12911:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94393c8aa000), last request at 1790656413 00000020:00000080:0.0:1790656630.623975:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea8a4 00000020:00080000:0.0:1790656630.623981:0:12911:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94393c8aa000): rc 0 00000020:00000080:0.0:1790656630.623987:0:12911:0:(genops.c:885:class_export_put()) final put ffff94393c8aa000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790656630.624882:0:12911:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790656630.624888:0:12911:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790656630.624892:0:12911:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790656630.624913:0:12911:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790656630.625039:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790656630.625054:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790656630.625060:0:12911:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943928721000 1 00000020:00000080:0.0:1790656630.625065:0:12911:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea7cb 00000020:00000080:0.0:1790656630.625070:0:12911:0:(genops.c:885:class_export_put()) final put ffff94390a328800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790656630.625074:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790656630.625078:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790656630.625081:0:12911:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790656630.625083:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff94390a36cd40) has no exports 00000020:00000080:1.0:1790656630.625200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393c8aa000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790656630.625209:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94393bfad000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790656630.625215:0:38:0:(genops.c:885:class_export_put()) final put ffff94393bfc3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790656630.625217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94393bfc3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790656630.625220:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790656630.625283:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a328800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790656630.669870:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656630.669884:0:12911:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790656630.669890:0:12911:0:(genops.c:885:class_export_put()) final put ffff943928727800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790656630.669894:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff943928727800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790656630.669900:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790656630.670056:0:12911:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff943928724800 00000020:01000000:3.0:1790656630.670079:0:12911:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790656630.670083:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656630.670088:0:12911:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790656630.670092:0:12911:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff94390a3699c0) has no exports 00000100:00100000:3.0:1790656630.670177:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff943903179800:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1790656630.670365:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9439121c9600:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1790656630.670445:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9439283d0400:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1790656630.674186:0:6714:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff943801828a00:6714] 3 exiting: rc = 0 00000100:00100000:3.0:1790656630.680545:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680554:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680561:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680569:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680576:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680580:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680586:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680615:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680622:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680627:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.680632:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681622:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681631:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681636:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681642:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681647:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681652:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681676:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681681:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681686:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681694:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681702:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681708:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681713:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681719:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681724:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681729:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681735:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681739:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681744:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681749:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681754:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681759:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681764:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681769:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681774:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681779:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681785:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681790:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681795:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681800:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681805:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681810:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681814:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681819:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681824:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681828:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681834:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681839:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681844:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681850:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681855:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681866:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681871:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681876:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681881:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681886:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681891:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681897:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681901:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681906:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681911:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681916:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.681922:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.692513:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff943910ab6200:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1790656630.692815:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff943910ab6000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1790656630.692927:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692938:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692945:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692951:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692957:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692963:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692969:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692974:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692980:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692986:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692991:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.692999:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693005:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693011:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693017:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693022:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693027:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693032:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693060:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693065:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693070:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693074:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693080:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693085:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693090:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693094:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693099:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693104:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693108:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693113:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693118:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693123:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693127:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693132:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693137:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693142:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693146:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693151:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693157:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693161:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693166:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693171:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693176:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693181:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693186:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693191:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693196:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693201:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693205:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693210:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693215:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693221:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693245:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693259:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693264:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693269:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693273:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693277:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693283:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693287:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693292:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693296:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693301:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.693306:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790656630.693955:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff943910ab6a00:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1790656630.694091:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff943910ab7600:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1790656630.694425:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694433:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694439:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694446:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694452:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694459:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694466:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694472:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694512:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694525:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694531:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694537:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694542:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694547:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694553:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694557:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694563:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694569:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694573:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694579:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694781:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694789:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694796:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694802:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694820:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694826:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694832:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694838:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694847:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694854:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694860:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694866:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694890:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694897:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694902:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694909:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694916:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694921:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694927:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694933:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694940:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694946:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694951:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694957:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694979:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694987:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.694993:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695002:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695007:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695014:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695019:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695025:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695031:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695036:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695051:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695059:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695079:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695089:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695094:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695105:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695111:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695116:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695122:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.695127:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790656630.708689:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9439285f9a00:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1790656630.708909:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9439285f9000:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1790656630.709088:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709096:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709101:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709107:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709112:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709117:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709123:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709127:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709132:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709137:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709142:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709147:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709151:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709157:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709162:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709167:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709172:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709178:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709183:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709188:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709193:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709212:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709217:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709222:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709227:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709232:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709237:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709252:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709257:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709262:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709267:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709271:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709276:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709281:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709286:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709291:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709296:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709301:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709306:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709310:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709315:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709320:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709325:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709329:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709407:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709412:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709417:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709422:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709426:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709431:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709435:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709440:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709445:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709450:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709454:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709458:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709533:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709538:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709543:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709548:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709553:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709558:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709563:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.709567:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.710121:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9439285f9200:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1790656630.710498:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9439285f9e00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1790656630.710725:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710732:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710738:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710743:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710748:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710752:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710757:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710762:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710767:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710772:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710778:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710784:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710789:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710793:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710799:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710803:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710808:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710813:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710818:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710822:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710827:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710831:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710836:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710840:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710844:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710848:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710852:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710868:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710873:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710878:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710882:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710887:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710891:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710895:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710899:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710904:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710908:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710912:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710917:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710921:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710925:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710930:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710935:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710940:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710945:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710950:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710954:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710959:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710963:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710968:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710973:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710978:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710982:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710986:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710991:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.710996:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711000:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711004:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711009:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711014:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711019:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711024:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711037:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711051:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790656630.711792:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9439285f8c00:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1790656630.711882:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9439285f9c00:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1790656630.711968:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711974:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711980:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711984:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711990:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.711995:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712000:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712006:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712011:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712017:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712022:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712027:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712032:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712037:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712051:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712057:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712062:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712067:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712072:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712078:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712084:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712089:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712093:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712098:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712103:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712109:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712114:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712118:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712123:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712128:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712132:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712137:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712142:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712159:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712163:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712169:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712175:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712180:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712185:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712190:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712195:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712200:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712206:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712211:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712216:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712221:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712236:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712752:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712758:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712763:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712768:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712773:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712777:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712782:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712787:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712793:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712798:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712803:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712808:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712812:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712817:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712821:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712826:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.712831:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656630.713802:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff94391f623400:5858] 2 exiting: rc = 0 00000100:00100000:0.0:1790656630.713980:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff94391f623e00:5856] 0 exiting: rc = 1 00000100:00100000:1.0:1790656630.714487:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff94391f623200:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1790656630.714620:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714628:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714634:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714640:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714656:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714662:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714668:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714672:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714678:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714684:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714694:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714701:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714707:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714713:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714719:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714724:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714731:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714748:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714755:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714760:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714765:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714770:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714775:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714780:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714786:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714791:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714796:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714802:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714808:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714813:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714819:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714825:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714830:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714836:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714843:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714848:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714854:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714859:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714865:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714878:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714884:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714903:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714910:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714916:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714922:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714928:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714934:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714939:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714946:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714951:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714958:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714963:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714969:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714975:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714981:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714986:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714991:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.714997:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715004:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715010:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715016:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715022:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715029:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656630.715034:0:12911:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790656630.720433:0:12911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790656630.720447:0:12911:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790656630.720453:0:12911:0:(genops.c:885:class_export_put()) final put ffff943928726000/MDS_uuid 00000020:00000080:2.0:1790656630.720458:0:12911:0:(genops.c:844:class_export_destroy()) destroying export ffff943928726000/MDS_uuid for MDS 00000020:01000000:2.0:1790656630.720463:0:12911:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790656630.720913:0:12911:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790656631.518971:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656632.546053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656632.991248:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269793792:0@lo:400:kworker.0 00000400:00000100:0.0:1790656632.991302:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877639269793792 offset 0 length 224: 4 00000100:00080000:2.0:1790656632.992943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790656632.992951:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790656632.992954:0:38:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656632.992961:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1790656632.992967:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790656632.992987:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94393c8ae000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656632.993019:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0d880 x1877639269793920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656632.993052:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790656632.993056:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790656632.993058:0:38:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656632.993061:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1790656632.993064:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790656632.993069:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff943802669000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656632.993096:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0ed80 x1877639269794048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790656632.993355:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793920:0@lo:38:kworker.0 00000400:00000100:3.0:1790656632.993395:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877639269793920 offset 0 length 520: 4 00000100:00100000:3.0:1790656632.993541:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269794048:0@lo:38:kworker.0 00000400:00000100:3.0:1790656632.993559:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877639269794048 offset 0 length 520: 4 00010000:00010000:2.0:1790656633.573971:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790656633.575796:0:13067:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790656633.588554:0:13067:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790656633.588618:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.588633:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.588641:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.588650:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.588693:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790656633.588699:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790656633.588724:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790656633.588736:0:13067:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0d880 x1877639269793920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790656652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656633.588763:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790656633.588770:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790656633.588776:0:13067:0:(import.c:65:import_set_state_nolock()) ffff94393c8ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790656633.588782:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790656633.588786:0:13067:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0d880 x1877639269793920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790656652 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656633.588794:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790656633.588797:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1790656633.588855:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269793920:0@lo:38:kworker.0 00010000:00010000:1.0:1790656633.590019:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590038:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590045:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590051:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590069:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790656633.590076:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590092:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590098:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590104:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656633.590112:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1790656633.590116:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790656633.590150:0:13067:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790656633.590154:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790656633.590158:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790656633.590164:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790656633.590168:0:13067:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff943928108000) has no exports 00000020:00080000:1.0:1790656633.590190:0:13067:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff943928108000) has no exports 00010000:00010000:2.0:1790656633.592163:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790656633.592175:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592187:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148ca00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656633.592191:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592201:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656633.592208:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656633.592214:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790656633.592216:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790656633.592219:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790656633.592261:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592267:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656633.592296:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592303:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94390148ca00/0x9c3a6e82066eab0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592316:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790656633.592388:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592394:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148cc00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656633.592397:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592403:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656633.592409:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656633.592413:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790656633.592415:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790656633.592417:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790656633.592430:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592435:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656633.592452:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592458:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94390148cc00/0x9c3a6e82066eab1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066eab21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592467:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790656633.592471:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592476:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97c00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:2.0:1790656633.592484:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592491:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790656633.592496:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656633.592501:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790656633.592503:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790656633.592505:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790656633.592518:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592523:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790656633.592530:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97c00/0x9c3a6e82066ead51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c3a6e82066ead58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656633.592547:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656633.592548:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656633.592550:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656633.592567:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269794176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656633.592652:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656633.592723:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269794304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656633.592748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656633.592766:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656633.592779:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269794432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656633.592798:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656633.592832:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794176 00000100:00100000:2.0:1790656633.592839:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794176 00000100:00100000:3.0:1790656633.592845:0:12912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794304 00000100:00100000:3.0:1790656633.592857:0:12912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794304 00000100:00100000:2.0:1790656633.592873:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794432 00000100:00100000:2.0:1790656633.592878:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794432 00000100:00100000:3.0:1790656633.592883:0:12912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790656633.592892:0:12912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1877639269794176:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656633.592898:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00020000:3.0:1790656633.592901:0:12912:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790656633 with bad export cookie 11257431723298695157 00000100:00100000:2.0:1790656633.592907:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1877639269794304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790656633.592915:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790656633 with bad export cookie 11257431723298695157 00000100:00100000:2.0:1790656633.592957:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1877639269794304:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (207us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790656633.592963:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790656633.592980:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790656633.592984:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1877639269794432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790656633.592988:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790656633 with bad export cookie 11257431723298695157 00000100:00100000:2.0:1790656633.593011:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1877639269794432:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (211us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790656633.593016:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790656633.593062:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790656633.593066:0:3299:0:(import.c:65:import_set_state_nolock()) ffff943928727000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790656633.593070:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1790656633.598527:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943909eac600 - data ffff94393fdf4798/ffff94392da8b000 00000020:01000000:1.0:1790656633.598695:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943932e3eae0 - data ffff943928aa3ca8/ffff943801991400 00000100:00100000:3.0:1790656633.604160:0:12912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1877639269794176:12345-0@lo:103:ldlm_bl.0 Request processed in 11262us (11502us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790656633.604175:0:12912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790656633.604189:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1790656633.618843:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790656633.642179:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.123@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790656633.642184:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790656633.642195:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0f800 x1877639269793792/t0(0) o400->MGC192.168.203.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790656648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656633.643263:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0d500 x1877639269794176/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790656649 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656633.643295:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0c000 x1877639269794304/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790656649 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656633.643314:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0c380 x1877639269794432/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790656649 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790656633.643384:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790656633.643388:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790656633.643390:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790656633.645363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4906672e-e41b-4f99-9a3c-531aeecaa79a:3301:1877639269793792:0@lo:400:kworker.0 00000100:00080000:0.0:1790656633.645461:0:3302:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff943928727000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1790656633.646243:0:3299:0:(import.c:65:import_set_state_nolock()) ffff943928727000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656633.646250:0:3299:0:(import.c:545:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 127 00000100:00080000:2.0:1790656633.646264:0:3299:0:(import.c:666:import_select_connection()) MGC192.168.203.123@tcp: import ffff943928727000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656633.646470:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4906672e-e41b-4f99-9a3c-531aeecaa79a:3302:1877639269794176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656633.646528:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bd3c380 x1877639269794560/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790656633.646567:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269794304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790656633.646740:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4906672e-e41b-4f99-9a3c-531aeecaa79a:3298:1877639269794560:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1790656633.646782:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877639269794560 offset 0 length 520: 4 00000100:00100000:3.0:1790656633.647051:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4906672e-e41b-4f99-9a3c-531aeecaa79a:3299:1877639269794432:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1790656633.674260:0:13067:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790656633.726942:0:13067:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea929 00000020:00000080:3.0:1790656633.726952:0:13067:0:(genops.c:885:class_export_put()) final put ffff94380119f800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790656633.726974:0:13067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94392d856000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790656633.726978:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94392d856000 2 00000020:01000004:3.0:1790656633.726981:0:13067:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94392d856000 from lustre-OST0000 00000020:00000080:3.0:1790656633.727002:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656633.727011:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790656633.727014:0:13067:0:(genops.c:885:class_export_put()) final put ffff94380119c000/lustre-OST0000_UUID 00000020:00000080:3.0:1790656633.727017:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff94380119c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1790656633.727036:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1790656633.727078:0:13067:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790656633.727082:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790656633.727086:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656633.727090:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790656633.727097:0:13067:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94380119b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790656633.727116:0:13067:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff94393c8999c0) has exports, disconnecting them 00000020:00080000:3.0:1790656633.727121:0:13067:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94380119b800), last request at 1790656429 00000020:00000080:3.0:1790656633.727125:0:13067:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea953 00000020:00080000:3.0:1790656633.727136:0:13067:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94380119b800): rc 0 00000020:00000080:3.0:1790656633.727141:0:13067:0:(genops.c:885:class_export_put()) final put ffff94380119b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790656633.727980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94380119f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790656633.727993:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94380119b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790656633.729749:0:13067:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790656633.729757:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790656633.729760:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790656633.729767:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790656633.729876:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94393c8ae000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790656633.730016:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790656633.730032:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790656633.730037:0:13067:0:(genops.c:885:class_export_put()) final put ffff943925520800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790656633.730040:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff943925520800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790656633.730048:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1790656633.730099:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94392d856000 1 00000020:00000080:2.0:1790656633.730104:0:13067:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea8e3 00000020:00000080:2.0:1790656633.730109:0:13067:0:(genops.c:885:class_export_put()) final put ffff943928628800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790656633.730123:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790656633.730127:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790656633.730131:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790656633.730134:0:13067:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff94393c9c19c0) has no exports 00000020:00000080:0.0:1790656633.730196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff943928628800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790656633.745395:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790656633.745511:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790656633.745516:0:13067:0:(genops.c:885:class_export_put()) final put ffff94392d853800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790656633.745520:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff94392d853800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790656633.745530:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790656633.746173:0:13067:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94392d854000 00000020:02000400:2.0:1790656633.746228:0:13067:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790656634.591035:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656635.615770:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790656636.490420:0:13217:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790656636.505784:0:13217:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790656636.505854:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.505870:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.505877:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.505884:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.505903:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790656636.505909:0:13217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790656636.505934:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790656636.505944:0:13217:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0ed80 x1877639269794048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790656652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656636.505967:0:13217:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790656636.505973:0:13217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790656636.505978:0:13217:0:(import.c:65:import_set_state_nolock()) ffff943802669000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790656636.505983:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790656636.505999:0:13217:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bb0ed80 x1877639269794048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790656652 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656636.506015:0:13217:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790656636.506018:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1790656636.506085:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269794048:0@lo:38:kworker.0 00010000:00010000:0.0:1790656636.506274:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656636.506281:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.506289:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94390148c400 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656636.506293:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.506312:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656636.506319:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656636.506323:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790656636.506325:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790656636.506327:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790656636.506339:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943928727000 00010000:00010000:0.0:1790656636.506344:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.506350:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94390148c400/0x9c3a6e82066eaaf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066eaaf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.507284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656636.507286:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656636.507288:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656636.511474:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511491:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511498:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511504:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511530:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790656636.511538:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511545:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511551:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511556:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656636.511576:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790656636.511612:0:13217:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790656636.511639:0:13217:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790656636.511644:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790656636.511648:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790656636.511654:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790656636.511658:0:13217:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff94393c89b380) has no exports 00000020:00080000:2.0:1790656636.511680:0:13217:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff94393c89b380) has no exports 00010000:00010000:0.0:1790656636.512515:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656636.512525:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512534:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480a00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656636.512538:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512547:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656636.512567:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656636.512573:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790656636.512575:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790656636.512577:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790656636.512715:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943928727000 00010000:00010000:0.0:1790656636.512720:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512727:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066eaafe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066eab05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512738:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656636.512742:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512748:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97000 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656636.512751:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512758:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656636.512764:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656636.512770:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790656636.512772:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790656636.512780:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790656636.512786:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943928727000 00010000:00010000:0.0:1790656636.512789:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943907c97000/0x9c3a6e82066ead3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066ead43 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.512807:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656636.512809:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656636.512811:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656636.513009:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790656636.515036:0:13217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943909eac900 - data ffff9439288541b0/ffff943935a19000 00000020:01000000:2.0:1790656636.515195:0:13217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9439281d8720 - data ffff94393fd3dbd0/ffff9439371d4800 00100000:10000000:2.0:1790656636.533513:0:13217:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790656636.564201:0:13217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea9f4 00000020:00000080:0.0:1790656636.564211:0:13217:0:(genops.c:885:class_export_put()) final put ffff94392dade000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790656636.564228:0:13217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94390a3a0800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790656636.564231:0:13217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94390a3a0800 2 00000020:01000004:0.0:1790656636.564235:0:13217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94390a3a0800 from lustre-OST0001 00000020:00000080:0.0:1790656636.564258:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790656636.564267:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790656636.564270:0:13217:0:(genops.c:885:class_export_put()) final put ffff94393c8c7000/lustre-OST0001_UUID 00000020:00000080:0.0:1790656636.564273:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffff94393c8c7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790656636.564279:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790656636.564376:0:13217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4906672e-e41b-4f99-9a3c-531aeecaa79a->MGS 00010000:00010000:0.0:1790656636.564390:0:13217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656636.564402:0:13217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656636.564408:0:13217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790656636.564411:0:13217:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790656636.564414:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790656636.564426:0:13217:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943928727000 00010000:00010000:0.0:1790656636.564439:0:13217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9439013fe200/0x9c3a6e82066ea906 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066ea90d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656636.564454:0:13217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656636.564460:0:13217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656636.564465:0:13217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790656636.564467:0:13217:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790656636.564469:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790656636.564478:0:13217:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943928727000 00010000:00010000:0.0:1790656636.564481:0:13217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943900031800/0x9c3a6e82066eab44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c3a6e82066eab4b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790656636.564496:0:13217:0:(import.c:65:import_set_state_nolock()) ffff943928727000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790656636.564500:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790656636.564502:0:13217:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790656636.564503:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790656636.564507:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790656636.564516:0:13217:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94393bd3c380 x1877639269794560/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790656643 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790656636.564529:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790656636.564531:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1790656636.564758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dade000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1790656636.564793:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4906672e-e41b-4f99-9a3c-531aeecaa79a:3298:1877639269794560:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1790656636.564863:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790656636.564871:0:13217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea7e7 00000020:00000080:0.0:1790656636.564877:0:13217:0:(genops.c:885:class_export_put()) final put ffff943928726800/4906672e-e41b-4f99-9a3c-531aeecaa79a 00000020:01000000:0.0:1790656636.564892:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.123@tcp (flags='') 00000020:00000080:0.0:1790656636.564897:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790656636.564902:0:13217:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790656636.564906:0:13217:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff94390a368000) has no exports 00000020:00000080:3.0:1790656636.564960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff943928726800/4906672e-e41b-4f99-9a3c-531aeecaa79a for MGC192.168.203.123@tcp 10000000:01000000:2.0:1790656636.565131:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790656636.565394:0:13217:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.123@tcp: client import never connected 00000100:00080000:0.0:1790656636.565397:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790656636.565399:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790656636.565402:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790656636.565403:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790656636.565445:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790656636.565451:0:13217:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.123@tcp (uuid 4906672e-e41b-4f99-9a3c-531aeecaa79a) 00000020:01000000:0.0:1790656636.565455:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790656636.565459:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790656636.565462:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790656636.565467:0:13217:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94392dadb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790656636.565473:0:13217:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff943802ee0000) has exports, disconnecting them 00000020:00080000:0.0:1790656636.565477:0:13217:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94392dadb000), last request at 1790656447 00000020:00000080:0.0:1790656636.565481:0:13217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066eaa1e 00000020:00080000:0.0:1790656636.565493:0:13217:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94392dadb000): rc 0 00000020:00000080:0.0:1790656636.565496:0:13217:0:(genops.c:885:class_export_put()) final put ffff94392dadb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790656636.566107:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943928727000 for MGC192.168.203.123@tcp 00000020:00000080:3.0:1790656636.566115:0:8:0:(genops.c:885:class_export_put()) final put ffff943928722800/4906672e-e41b-4f99-9a3c-531aeecaa79a 00000020:00000080:3.0:1790656636.566118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff943928722800/4906672e-e41b-4f99-9a3c-531aeecaa79a for MGC192.168.203.123@tcp 00000020:01000000:3.0:1790656636.566124:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.123@tcp (4906672e-e41b-4f99-9a3c-531aeecaa79a) 00000020:00000080:3.0:1790656636.566352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94392dadb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790656636.582686:0:13217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790656636.582695:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790656636.582699:0:13217:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790656636.582705:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790656636.582796:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff943802669000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1790656636.586667:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790656636.598103:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1790656636.598344:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff943903178e00:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1790656636.599676:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff943909bdfa00:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1790656636.599859:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600117:0:12912:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff94393bc38000:12912] 3 exiting: rc = 0 00000100:00100000:2.0:1790656636.600237:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff943908ed8000:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1790656636.600289:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff943908ed9600:5830] 2 exiting: rc = 0 00000100:00100000:0.0:1790656636.600423:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff943908ed8e00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1790656636.600643:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600651:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600659:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600664:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600670:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600676:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600681:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600686:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600692:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600712:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600717:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600723:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600728:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600734:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600740:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600745:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600751:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600769:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600775:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600780:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600785:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600790:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600795:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600800:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600806:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600810:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600815:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600820:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600825:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600830:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600835:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600840:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600846:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600851:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600858:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600863:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600868:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600873:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600878:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600883:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600888:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600893:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600898:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600903:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600915:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600921:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600926:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600932:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600937:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600943:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600948:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600954:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600959:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600965:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600971:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600976:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600980:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600986:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600991:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.600997:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.601014:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.601020:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.601025:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.601031:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790656636.602061:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656636.602069:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790656636.602074:0:13217:0:(genops.c:885:class_export_put()) final put ffff94380266b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790656636.602078:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffff94380266b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790656636.602085:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790656636.602122:0:13217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94390a3a0800 1 00000020:00000080:3.0:1790656636.602127:0:13217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9c3a6e82066ea9c3 00000020:00000080:3.0:1790656636.602134:0:13217:0:(genops.c:885:class_export_put()) final put ffff94390a3a3800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790656636.602153:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790656636.602159:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656636.602163:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790656636.602179:0:13217:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9439281099c0) has no exports 00000020:00000080:2.0:1790656636.602308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a3a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790656636.619916:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790656636.619930:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790656636.619934:0:13217:0:(genops.c:885:class_export_put()) final put ffff94390a3a2800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790656636.619939:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffff94390a3a2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790656636.619946:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790656636.623296:0:13217:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94390a3a7000 00000020:01000000:3.0:1790656636.623327:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790656636.623340:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790656636.623346:0:13217:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790656636.623350:0:13217:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff94392810cd40) has no exports 00000020:00000080:3.0:1790656636.623372:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790656636.623379:0:13217:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790656636.623383:0:13217:0:(genops.c:885:class_export_put()) final put ffff943928629000/OSS_uuid 00000020:00000080:3.0:1790656636.623386:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffff943928629000/OSS_uuid for OSS 00000020:01000000:3.0:1790656636.623397:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1790656636.623880:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff94392819b400:6692] 2 exiting: rc = 0 00000100:00100000:3.0:1790656636.623957:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff94390971fc00:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1790656636.625315:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff94392819ac00:6691] 1 exiting: rc = 0 00000100:00080000:1.0:1790656636.626276:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790656636.626526:0:8825:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff94393f9e7000:8825] 3 exiting: rc = 0 00000100:00100000:3.0:1790656636.626942:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626950:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626957:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626962:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626967:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626972:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626977:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626982:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626987:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626992:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.626997:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627014:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627019:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627025:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627030:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627035:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627040:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627045:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627051:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627056:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627061:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627066:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627070:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627090:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627095:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627100:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627105:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627110:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627181:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627189:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627194:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627198:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627203:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627208:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627214:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627219:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627224:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627229:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627307:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627313:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627318:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627324:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627329:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627334:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627339:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627345:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627350:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627355:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627361:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627367:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627371:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627376:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627381:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627387:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627393:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627398:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627403:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627408:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627420:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627425:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627429:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627434:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627440:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.627444:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790656636.629247:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94390971e600:6694] 1 exiting: rc = 0 00000100:00100000:2.0:1790656636.629405:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94390971f000:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1790656636.629679:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629688:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629693:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629698:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629704:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629709:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629714:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629719:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629726:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629793:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629800:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629805:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629811:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629817:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629822:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629827:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629832:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629837:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629842:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629846:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629851:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629856:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629862:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629867:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629872:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629877:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629882:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629888:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629892:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629907:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629912:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629917:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629922:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629927:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629932:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629936:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629941:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629946:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629963:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629969:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629974:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629979:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629985:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629990:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.629995:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630010:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630016:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630068:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630075:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630081:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630086:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630090:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630096:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630101:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630106:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630111:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630116:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630121:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630127:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630132:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630137:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630141:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630146:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.630151:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631053:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94390971f400:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1790656636.631289:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94390971f200:6695] 0 exiting: rc = 1 00000100:00100000:1.0:1790656636.631673:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9439097ba800:6697] 2 exiting: rc = 0 00000100:00100000:3.0:1790656636.631799:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631806:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631812:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631818:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631823:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631828:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631834:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631840:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631845:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631851:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631856:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631861:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631867:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631881:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631887:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631893:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631898:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631904:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631910:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631915:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631920:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631926:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631932:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631937:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631943:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631949:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631954:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631958:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631964:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631969:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631974:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631979:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631985:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.631990:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632030:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632038:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632043:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632049:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632058:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632063:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632069:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632074:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632079:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632084:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632089:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632093:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632098:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632102:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632106:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632111:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632116:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632122:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632127:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632132:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632137:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632142:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632146:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632151:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632166:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632173:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632500:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632510:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632515:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.632521:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790656636.637246:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9439097baa00:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1790656636.637428:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9439097ba400:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1790656636.637486:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637494:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637499:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637504:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637509:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637529:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637534:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637539:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637545:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637550:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637556:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637562:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637568:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637572:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637577:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637581:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637586:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637654:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637660:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637665:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637670:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637675:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637680:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637685:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637690:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637695:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637700:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637705:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637710:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637715:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637720:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637724:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637729:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637734:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637738:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637743:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637748:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637753:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637759:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637764:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637777:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637783:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637787:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637792:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637796:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637801:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637807:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637812:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637817:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637821:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637826:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637832:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637836:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637841:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637846:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637851:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637857:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637861:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637867:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637872:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637877:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637882:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637887:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.637893:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790656636.639335:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9439283c1600:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1790656636.642294:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9439283c0200:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1790656636.642758:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642774:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642790:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642802:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642808:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642814:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642826:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642833:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642838:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642844:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642851:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642859:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642865:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642870:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642876:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642882:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642888:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642893:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642913:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642920:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642926:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642931:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642937:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642943:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642949:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642957:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642964:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642970:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642976:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.642982:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643013:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643023:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643038:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643045:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643051:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643057:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643062:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643077:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643082:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643088:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643093:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643098:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643117:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643135:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643142:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643148:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643154:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643159:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643165:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643171:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643177:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643183:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643190:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643197:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643220:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643228:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643234:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643239:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643244:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643250:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643257:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643263:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643268:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790656636.643281:0:13217:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790656636.655289:0:13217:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1790656653.322060:0:13833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790656661.251710:0:14295:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790656661.251716:0:14295:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790656661.251838:0:14295:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff943907838800 00000020:01000004:1.0:1790656661.251852:0:14295:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790656661.251860:0:14295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790656661.251872:0:14295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94390a36b380) 00000020:00000080:1.0:1790656661.251884:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790656661.281460:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790656661.283294:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790656661.283654:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1790656661.283796:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1790656661.284100:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1790656661.284203:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1790656661.284299:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1790656661.284490:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790656661.284562:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1790656661.284845:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1790656661.286168:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 590: rc = 0 00100000:10000000:2.0:1790656661.286303:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 590: rc = 0 00100000:10000000:2.0:1790656661.286835:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 599: rc = 0 00100000:10000000:2.0:1790656661.287318:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 599: rc = 0 00100000:10000000:2.0:1790656661.288367:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 599: rc = 0 00100000:10000000:2.0:1790656661.288642:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 599: rc = 0 00100000:10000000:2.0:1790656661.288896:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 599: rc = 0 00100000:10000000:2.0:1790656661.290359:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 599: rc = 0 00100000:10000000:2.0:1790656661.290648:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 599: rc = 0 00100000:10000000:2.0:1790656661.290909:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 599: rc = 0 00100000:10000000:3.0:1790656661.292475:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 599: rc = 0 00100000:10000000:3.0:1790656661.292769:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 599: rc = 0 00100000:10000000:3.0:1790656661.293015:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 599: rc = 0 00100000:10000000:3.0:1790656661.293631:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 599: rc = 0 00100000:10000000:3.0:1790656661.294136:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 768: rc = 0 00100000:10000000:3.0:1790656661.294378:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 768: rc = 0 00100000:10000000:3.0:1790656661.294661:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 768: rc = 0 00100000:10000000:3.0:1790656661.294918:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 768: rc = 0 00100000:10000000:3.0:1790656661.295300:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 768: rc = 0 00100000:10000000:3.0:1790656661.295548:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 768: rc = 0 00100000:10000000:3.0:1790656661.295848:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 768: rc = 0 00100000:10000000:3.0:1790656661.296237:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 768: rc = 0 00100000:10000000:3.0:1790656661.296475:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 768: rc = 0 00100000:10000000:3.0:1790656661.296853:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 768: rc = 0 00100000:10000000:3.0:1790656661.297112:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 768: rc = 0 00100000:10000000:3.0:1790656661.297357:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 768: rc = 0 00100000:10000000:3.0:1790656661.297631:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 768: rc = 0 00100000:10000000:3.0:1790656661.297887:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 768: rc = 0 00100000:10000000:3.0:1790656661.298147:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 768: rc = 0 00100000:10000000:3.0:1790656661.298395:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 768: rc = 0 00100000:10000000:3.0:1790656661.298808:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 768: rc = 0 00100000:10000000:3.0:1790656661.299125:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 768: rc = 0 00100000:10000000:3.0:1790656661.299396:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 768: rc = 0 00100000:10000000:3.0:1790656661.299769:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 768: rc = 0 00100000:10000000:3.0:1790656661.300046:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 768: rc = 0 00100000:10000000:3.0:1790656661.300327:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 768: rc = 0 00100000:10000000:3.0:1790656661.300725:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 768: rc = 0 00100000:10000000:3.0:1790656661.300983:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 768: rc = 0 00100000:10000000:3.0:1790656661.301419:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 768: rc = 0 00100000:10000000:3.0:1790656661.301757:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 768: rc = 0 00100000:10000000:3.0:1790656661.302104:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 768: rc = 0 00100000:10000000:3.0:1790656661.302346:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 768: rc = 0 00100000:10000000:3.0:1790656661.302921:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 768: rc = 0 00100000:10000000:3.0:1790656661.303188:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 768: rc = 0 00100000:10000000:3.0:1790656661.303451:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 768: rc = 0 00100000:10000000:3.0:1790656661.303724:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 768: rc = 0 00100000:10000000:3.0:1790656661.304085:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 245: rc = 0 00100000:10000000:3.0:1790656661.304587:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790656661.304786:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:3.0:1790656661.304997:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790656661.305072:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:3.0:1790656661.305257:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790656661.305332:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:3.0:1790656661.305693:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1790656661.305759:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 594: rc = 0 00100000:10000000:3.0:1790656661.306287:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790656661.306367:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 594: rc = 0 00100000:10000000:3.0:1790656661.306562:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1790656661.306656:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 594: rc = 0 00000020:00000080:3.0:1790656661.306946:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790656661.306954:0:14295:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790656661.306963:0:14295:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebada 00000020:01000004:3.0:1790656661.306971:0:14295:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790656661.306975:0:14295:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790656661.306980:0:14295:0:(tgt_mount.c:101:server_register_mount()) register mount ffff943907838800 from MGS 00000020:01000004:3.0:1790656661.306983:0:14295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790656661.307100:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff943802ee0000) 00000020:00000080:3.0:1790656661.307111:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790656661.307162:0:14295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943907838800 from MGS, refs=2 00080000:01000000:3.0:1790656661.307166:0:14295:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790656661.307172:0:14295:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebae8 00000100:00100000:3.0:1790656661.307290:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790656661.307411:0:14295:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790656661.307417:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790656661.307833:0:14295:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790656661.307841:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790656661.308788:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.308952:0:14295:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790656661.308958:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790656661.309498:0:14295:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790656661.309505:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790656661.309963:0:14295:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790656661.309970:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790656661.310512:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656661.310515:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656661.310517:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656661.310965:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656661.310968:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656661.310970:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656661.311469:0:14295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790656661.314157:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790656661.320463:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790656661.320480:0:14295:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790656661.320483:0:14295:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790656661.321864:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790656661.321968:0:14295:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790656661.322100:0:14295:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790656661.322537:0:14295:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790656661.322878:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.323019:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790656661.323025:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790656661.325159:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790656661.325169:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790656661.325487:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790656661.325493:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790656661.326335:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790656661.326354:0:14295:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:3.0:1790656661.326356:0:14295:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790656661.326382:0:14295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:3.0:1790656661.326393:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (ffff943802ee19c0) 00000020:00000080:3.0:1790656661.326408:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790656661.326480:0:14295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94390783c800@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1790656661.326652:0:14295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:3.0:1790656661.326658:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790656661.332247:0:14309:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790656661.334214:0:14311:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790656661.334299:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid c05058d9-4e17-4bd7-bcb7-bf10861cf2ff) 00000020:00000080:1.0:1790656661.334320:0:14295:0:(genops.c:1384:class_connect()) connect: client c05058d9-4e17-4bd7-bcb7-bf10861cf2ff, cookie 0x9c3a6e82066ebaf6 00000100:00080000:1.0:1790656661.334331:0:14295:0:(import.c:545:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790656661.334341:0:14295:0:(import.c:666:import_select_connection()) MGC192.168.203.123@tcp: import ffff94390783c800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656661.334371:0:14295:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bea6a00 x1877639269794688/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790656661.334562:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3298:1877639269794688:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790656661.334641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790656661.334770:0:14295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c05058d9-4e17-4bd7-bcb7-bf10861cf2ff->MGS 00000020:01000004:1.0:1790656661.334789:0:14295:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790656661.334812:0:14295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790656661.334835:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94390a368000) 00000020:00000080:1.0:1790656661.334852:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790656661.338967:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794688 00000100:00100000:0.0:1790656661.338981:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794688 00000100:00100000:0.0:1790656661.339017:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656661.339025:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1877639269794688:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790656661.339120:0:14305:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c05058d9-4e17-4bd7-bcb7-bf10861cf2ff@0@lo t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:0.0:1790656661.339157:0:14305:0:(genops.c:1384:class_connect()) connect: client c05058d9-4e17-4bd7-bcb7-bf10861cf2ff, cookie 0x9c3a6e82066ebb04 00000100:00080000:0.0:1790656661.339285:0:14305:0:(import.c:65:import_set_state_nolock()) ffff94392862d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656661.340186:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+5:3298:x1877639269794688:12345-0@lo:250:mount.lustre.0 Request processed in 1157us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.340196:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790656661.340279:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790656661.340288:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:3.0:1790656661.340296:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790656661.340300:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790656661.340304:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390783c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790656661.340306:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790656661.340323:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790656661.340328:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3298:1877639269794688:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790656661.344365:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790656661.344537:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790656661.344543:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790656661.345256:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790656661.345263:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790656661.345522:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790656661.345528:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790656661.347009:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.347389:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790656661.347393:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790656661.347971:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790656661.347978:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790656661.373804:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.374018:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790656661.374025:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790656661.375013:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790656661.375021:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790656661.375525:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.375884:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656661.375890:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790656661.376428:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656661.376435:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790656661.376940:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.377153:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656661.377158:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790656661.377553:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656661.377560:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790656661.378291:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.378424:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790656661.378430:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790656661.379007:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790656661.379014:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790656661.394330:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656661.394535:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790656661.394541:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790656661.395935:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790656661.395946:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790656661.401749:0:14295:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790656661.401766:0:14295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790656661.403432:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790656661.403459:0:14295:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790656661.403465:0:14295:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790656661.403620:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790656661.403723:0:14295:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790656661.403728:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790656661.403730:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.403731:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.403732:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.403733:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.403734:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.403736:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.403737:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.403739:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.403740:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656661.403742:0:14295:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790656661.403744:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790656661.403745:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.403746:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.403747:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.403748:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.403750:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.403751:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.403752:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.403753:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.403754:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656661.403780:0:14295:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790656661.403800:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269794816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790656661.403880:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656661.403997:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794816 00000100:00100000:0.0:1790656661.404006:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794816 00000100:00100000:0.0:1790656661.404055:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656661.404065:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+5:14295:x1877639269794816:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790656661.404111:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790656661.404115:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790656661.404117:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1790656661.404706:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db300 going to sleep for 11 seconds 10000000:01000000:2.0:1790656661.408459:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790656661.408879:0:14308:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1790656661.409933:0:14330:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790656661.409939:0:14330:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790656661.409941:0:14330:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1790656661.409976:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790656661.410292:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790656661.410302:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790656661.417721:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+5:14295:x1877639269794816:12345-0@lo:253:mount.lustre.0 Request processed in 13650us (13834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.417739:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656661.417844:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269794816:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790656661.417873:0:14295:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790656661.417876:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790656661.417878:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.417879:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.417881:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.417882:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.417883:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.417885:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.417886:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.417888:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.417890:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790656661.417912:0:14295:0:(tgt_mount.c:101:server_register_mount()) register mount ffff943907838800 from lustre-MDT0000 10000000:01000000:2.0:1790656661.417936:0:14295:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790656661.417938:0:14295:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790656661.417942:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff943802ee19c0 10000000:01000000:2.0:1790656661.417947:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656661.417954:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff943802ee19c0 from 1 10000000:01000000:2.0:1790656661.417957:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790656661.417992:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.418122:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.418131:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.418151:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269794944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656661.418189:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.418261:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db780 going to sleep for 11 seconds 00000100:00100000:0.0:1790656661.418297:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269794944 00000100:00100000:0.0:1790656661.418304:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269794944 00000100:00100000:0.0:1790656661.418378:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790656661.418387:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+5:14295:x1877639269794944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656661.418399:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656661.418412:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b506800/0x9c3a6e82066ebb12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebb0b expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.418433:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b506800/0x9c3a6e82066ebb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb0b expref: 6 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.418444:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b506800/0x9c3a6e82066ebb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb0b expref: 6 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.418452:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506800, rc 0) 00000100:00100000:0.0:1790656661.418494:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+6:14295:x1877639269794944:12345-0@lo:101:mount.lustre.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.418507:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656661.418564:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269794944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656661.418577:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.418617:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.418675:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656661.418699:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.418974:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db780 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.419105:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795072 00000100:00100000:1.0:1790656661.419110:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795072 00000100:00100000:1.0:1790656661.419134:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790656661.419140:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+6:14295:x1877639269795072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656661.419366:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+6:14295:x1877639269795072:12345-0@lo:501:mount.lustre.0 Request processed in 225us (666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656661.419372:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656661.419500:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790656661.419530:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790656661.419551:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.419561:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656661.419568:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff943907838800 10000000:01000000:2.0:1790656661.419573:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790656661.419577:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff943907838800 10000000:01000000:2.0:1790656661.419579:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790656661.419582:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff943907838800 from 1 10000000:01000000:2.0:1790656661.419584:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790656661.419659:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.419668:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.419676:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.419698:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656661.419725:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.419743:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.419859:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795200 00000100:00100000:1.0:1790656661.419864:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795200 00000100:00100000:1.0:1790656661.419884:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790656661.419889:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+6:14295:x1877639269795200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656661.419897:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656661.419908:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f07600/0x9c3a6e82066ebb20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebb19 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.419925:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f07600/0x9c3a6e82066ebb20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb19 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.419934:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f07600/0x9c3a6e82066ebb20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb19 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.419942:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07600, rc 0) 00000100:00100000:1.0:1790656661.419981:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+7:14295:x1877639269795200:12345-0@lo:101:mount.lustre.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.419987:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656661.420174:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656661.420186:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb20 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.420194:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebb20 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656661.420206:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790656661.420220:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb20 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.420227:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481e00/0x9c3a6e82066ebb19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb20 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656661.420232:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790656661.420236:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656661.420240:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff943907838800 10000000:01000000:2.0:1790656661.420243:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790656661.420246:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790656661.420248:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790656661.420261:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.420268:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.420283:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.420294:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656661.420321:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.420334:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790656661.420383:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795328 00000100:00100000:0.0:1790656661.420387:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795328 00000100:00100000:0.0:1790656661.420410:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656661.420417:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+7:14295:x1877639269795328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656661.420424:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656661.420432:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b506000/0x9c3a6e82066ebb2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebb27 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.420444:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b506000/0x9c3a6e82066ebb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb27 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.420452:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b506000/0x9c3a6e82066ebb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebb27 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.420458:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506000, rc 0) 00000100:00100000:0.0:1790656661.420498:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+8:14295:x1877639269795328:12345-0@lo:101:mount.lustre.0 Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.420504:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656661.420710:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656661.420721:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb2e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.420728:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebb2e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.420770:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656661.420795:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.420834:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.420880:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795456 00000100:00100000:1.0:1790656661.420885:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795456 00000100:00100000:1.0:1790656661.420917:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790656661.420924:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+8:14295:x1877639269795456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656661.421364:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14295:x1877639269795456:12345-0@lo:501:mount.lustre.0 Request processed in 440us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.421372:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790656661.421495:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656661.421524:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790656661.421558:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.421577:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.421707:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795584 00000100:00100000:1.0:1790656661.421712:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795584 00000100:00100000:1.0:1790656661.421740:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790656661.421746:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14295:x1877639269795584:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656661.422326:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14295:x1877639269795584:12345-0@lo:503:mount.lustre.0 Request processed in 577us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.422334:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656661.422401:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269795584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656661.422887:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14331:1877639269795712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656661.422927:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656661.422989:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392558f780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656661.423138:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269795712 00000100:00100000:2.0:1790656661.423144:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269795712 00000100:00100000:2.0:1790656661.423179:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790656661.423186:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14331:x1877639269795712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656661.423479:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14331:x1877639269795712:12345-0@lo:502:llog_process_th.0 Request processed in 292us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656661.423486:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656661.423577:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14331:1877639269795712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790656661.423792:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656661.423804:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.423807:0:14331:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790656661.423813:0:14331:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790656661.423833:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656661.423847:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94393c9c4d40) 00000020:00000080:0.0:1790656661.423865:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790656661.423871:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790656661.423934:0:14331:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790656661.423941:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebb3c 00000020:00000080:0.0:1790656661.424262:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790656661.424267:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656661.424270:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.424272:0:14331:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790656661.424275:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656661.424278:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.424279:0:14331:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790656661.424282:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656661.424289:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94393c9c0000) 00000020:00000080:0.0:1790656661.424299:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790656661.424303:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790656661.424305:0:14331:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790656661.424307:0:14331:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790656661.424313:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790656661.424354:0:14331:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943907838800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790656661.424366:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94393c9c19c0) 00000020:00000080:0.0:1790656661.424373:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790656661.424413:0:14331:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790656661.424418:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ebb51 00000020:00000080:0.0:1790656661.424506:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790656661.424511:0:14331:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790656661.424515:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c3a6e82066ebb58 00080000:01000000:0.0:1790656661.424519:0:14331:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790656661.424522:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebb5f 00010000:00010000:2.0:1790656661.486845:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790656661.487431:0:14331:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1790656661.487584:0:14331:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790656661.488546:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94393c8999c0) 00000020:00000080:2.0:1790656661.488562:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790656661.488662:0:14331:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790656661.488668:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebb6d 00000020:00000080:1.0:1790656661.489204:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790656661.497378:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c3a6e82066ebb74 00000020:00000080:0.0:1790656661.499911:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790656661.499924:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656661.499933:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.499940:0:14331:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790656661.499944:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656661.499950:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.499952:0:14331:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790656661.499955:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790656661.499994:0:14331:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790656661.500007:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656661.500010:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.500011:0:14331:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790656661.500014:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790656661.500016:0:14331:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790656661.500018:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790656661.500019:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790656661.500021:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790656661.500023:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.500024:0:14331:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790656661.500027:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790656661.500030:0:14331:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790656661.500033:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656661.500035:0:14331:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790656661.500038:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790656661.500043:0:14331:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:0.0:1790656661.500068:0:14331:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790656661.500071:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656661.500084:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94393c9c3380) 00000020:00000080:0.0:1790656661.500100:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790656661.500104:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790656661.500164:0:14331:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790656661.500170:0:14331:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790656661.500176:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebb82 00010000:00080000:0.0:1790656661.500211:0:14331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943928647000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1790656661.500443:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1790656661.501121:0:14331:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790656661.501166:0:14331:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790656661.502191:0:14331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656661.502247:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790656661.502305:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1790656661.504304:0:14335:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790656661.504311:0:14335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790656661.505372:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656661.505384:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790656661.505417:0:14331:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790656661.505436:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ebb89 00000100:00080000:3.0:1790656661.505446:0:14331:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790656661.505457:0:14331:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff943928647000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656661.505493:0:14331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bd3c380 x1877639269795840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790656661.505565:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269795840:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790656661.505717:0:14331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790656661.505769:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.505774:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.505776:0:14331:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790656661.505780:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790656661.505782:0:14331:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790656661.505784:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790656661.505786:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790656661.505787:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790656661.505790:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.505791:0:14331:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790656661.505794:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790656661.505797:0:14331:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790656661.505802:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.505803:0:14331:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790656661.505806:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790656661.505809:0:14331:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:3.0:1790656661.505845:0:14331:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790656661.505848:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790656661.505858:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff943802ee3380) 00000020:00000080:3.0:1790656661.505870:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790656661.505874:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790656661.505926:0:14331:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790656661.505940:0:14331:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790656661.505950:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c3a6e82066ebb97 00010000:00080000:3.0:1790656661.505978:0:14331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94390916a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00000400:00000100:0.0:1790656661.506129:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877639269795840 offset 0 length 520: 4 00010000:00010000:3.0:1790656661.506507:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790656661.506815:0:14331:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790656661.506850:0:14331:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790656661.507418:0:14331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656661.507479:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790656661.507549:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790656661.508240:0:14337:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790656661.508245:0:14337:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790656661.508965:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790656661.508975:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790656661.509004:0:14331:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790656661.509022:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ebb9e 00000100:00080000:3.0:1790656661.509030:0:14331:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790656661.509109:0:14331:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94390916a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656661.509143:0:14331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bd3fb80 x1877639269795968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790656661.509207:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269795968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790656661.509268:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877639269795968 offset 0 length 520: 4 00000100:00080000:3.0:1790656661.509322:0:14331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790656661.509374:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.509378:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.509380:0:14331:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790656661.509383:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656661.509387:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.509389:0:14331:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790656661.509392:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790656661.509393:0:14331:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790656661.509396:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.509398:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.509400:0:14331:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790656661.509402:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656661.509404:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.509410:0:14331:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790656661.509415:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790656661.509440:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14331:1877639269796096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656661.509485:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.509516:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796096 00000100:00100000:3.0:1790656661.509523:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796096 00000100:00100000:3.0:1790656661.509557:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790656661.509566:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14331:x1877639269796096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656661.509877:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14331:x1877639269796096:12345-0@lo:502:llog_process_th.0 Request processed in 310us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656661.509884:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790656661.509928:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390993c300 going to sleep for 11 seconds 00000100:00100000:3.0:1790656661.509947:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14331:1877639269796096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656661.509970:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.509974:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.509975:0:14331:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790656661.509978:0:14331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790656661.510231:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1790656661.510255:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790656661.510275:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb2e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.510287:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481000/0x9c3a6e82066ebb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb2e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656661.510295:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943907838800 from 1 10000000:01000000:2.0:1790656661.510298:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790656661.510324:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.510332:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.510342:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.510356:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656661.510392:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.510410:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db480 going to sleep for 11 seconds 00000100:00100000:3.0:1790656661.510519:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796224 00000100:00100000:3.0:1790656661.510524:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796224 00000100:00100000:3.0:1790656661.510583:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790656661.510617:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+9:14295:x1877639269796224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790656661.510627:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656661.510649:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebba5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.510670:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 10 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.510680:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 10 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.510695:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be34000, rc 0) 00000100:00100000:3.0:1790656661.510725:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+10:14295:x1877639269796224:12345-0@lo:101:mount.lustre.0 Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656661.510731:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656661.510796:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656661.510809:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.510826:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.511329:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796352:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790656661.511367:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.512053:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.512179:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796352 00000100:00100000:1.0:1790656661.512186:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796352 00000100:00100000:1.0:1790656661.512219:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790656661.512227:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+10:14295:x1877639269796352:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790656661.512245:0:14307:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790656661.512250:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790656661.512337:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+10:14295:x1877639269796352:12345-0@lo:256:mount.lustre.0 Request processed in 110us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.512344:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656661.512455:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796352:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790656661.513176:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790656661.513196:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.513208:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656661.513393:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943907838800 from 1 10000000:01000000:3.0:1790656661.513398:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656661.513430:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.513439:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.513448:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656661.513463:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790656661.513499:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.513555:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff94390993ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.513583:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796480 00000100:00100000:1.0:1790656661.513731:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796480 00000100:00100000:1.0:1790656661.513767:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790656661.513773:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+10:14295:x1877639269796480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656661.513784:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656661.513795:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebbb3 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.513813:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.513834:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656661.513842:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06800, rc 0) 00000100:00100000:1.0:1790656661.513879:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269796480:12345-0@lo:101:mount.lustre.0 Request processed in 106us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.513885:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790656661.513947:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656661.513959:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.513968:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656661.514025:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656661.514059:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.514082:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.514170:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796608 00000100:00100000:1.0:1790656661.514174:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796608 00000100:00100000:1.0:1790656661.514201:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790656661.514208:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269796608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656661.514562:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269796608:12345-0@lo:501:mount.lustre.0 Request processed in 353us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.514568:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656661.514775:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656661.514809:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790656661.514857:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.514886:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.514931:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796736 00000100:00100000:1.0:1790656661.514936:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796736 00000100:00100000:1.0:1790656661.514966:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790656661.514972:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269796736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656661.515126:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269796736:12345-0@lo:503:mount.lustre.0 Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.515132:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790656661.515259:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269796736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790656661.515677:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14339:1877639269796864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656661.515714:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.515734:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656661.516008:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796864 00000100:00100000:2.0:1790656661.516014:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796864 00000100:00100000:2.0:1790656661.516053:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790656661.516061:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14339:x1877639269796864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656661.516266:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14339:x1877639269796864:12345-0@lo:502:llog_process_th.0 Request processed in 205us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656661.516273:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656661.516414:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14339:1877639269796864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656661.516439:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656661.516448:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516450:0:14339:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790656661.516456:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943907838800 00000020:00000080:3.0:1790656661.516458:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790656661.516471:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.516473:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516474:0:14339:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790656661.516477:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656661.516479:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516481:0:14339:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790656661.516484:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943907838800 00000020:00000080:3.0:1790656661.516486:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790656661.516544:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.516548:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516550:0:14339:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790656661.516552:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790656661.516554:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516555:0:14339:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790656661.516559:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff943907838800 00000020:00000080:3.0:1790656661.516561:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790656661.516620:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14339:1877639269796992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656661.516665:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.516690:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269796992 00000100:00100000:3.0:1790656661.516694:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269796992 00000100:00100000:3.0:1790656661.516719:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790656661.516725:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14339:x1877639269796992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790656661.516850:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14339:x1877639269796992:12345-0@lo:502:llog_process_th.0 Request processed in 123us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656661.516856:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790656661.516896:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656661.516908:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14339:1877639269796992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790656661.516926:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790656661.516929:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790656661.516931:0:14339:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790656661.516939:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790656661.518963:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790656661.518992:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656661.519725:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.519742:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656661.519792:0:14295:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790656661.519795:0:14295:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff943907838800 10000000:01000000:3.0:1790656661.519798:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff943907838800 10000000:01000000:3.0:1790656661.519802:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790656661.519807:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943907838800 from 1 10000000:01000000:3.0:1790656661.519810:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790656661.519851:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.519861:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.519872:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656661.519893:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790656661.519949:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.519985:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1790656661.520007:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797120 00000100:00100000:3.0:1790656661.520014:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797120 00000100:00100000:3.0:1790656661.520121:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790656661.520130:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269797120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790656661.520151:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656661.520161:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393be35200/0x9c3a6e82066ebbc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebbc1 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.520183:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393be35200/0x9c3a6e82066ebbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbc1 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.520195:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393be35200/0x9c3a6e82066ebbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbc1 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.520203:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393be35200, rc 0) 00000100:00100000:3.0:1790656661.520238:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797120:12345-0@lo:101:mount.lustre.0 Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656661.520245:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790656661.520289:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790656661.520302:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbc8 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.520312:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebbc8 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656661.520353:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790656661.520374:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.520389:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf780 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.526793:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797248 00000100:00100000:1.0:1790656661.526808:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797248 00000100:00100000:1.0:1790656661.526868:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790656661.526878:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656661.527273:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797248:12345-0@lo:501:mount.lustre.0 Request processed in 394us (6896us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.527282:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790656661.527844:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790656661.527894:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790656661.527940:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.527985:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790656661.528139:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797376 00000100:00100000:0.0:1790656661.528145:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797376 00000100:00100000:0.0:1790656661.528179:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790656661.528186:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656661.528352:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797376:12345-0@lo:503:mount.lustre.0 Request processed in 166us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.528359:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790656661.528754:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656661.529854:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14343:1877639269797504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790656661.529916:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656661.529957:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656661.530714:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797504 00000100:00100000:1.0:1790656661.530722:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797504 00000100:00100000:1.0:1790656661.530763:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790656661.530771:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14343:x1877639269797504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656661.531161:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14343:1877639269797504:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790656661.531225:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790656661.531240:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94393c89b380) 00000020:00000080:2.0:1790656661.531259:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790656661.531336:0:14343:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943907838800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790656661.531340:0:14343:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943907838800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790656661.531343:0:14343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943907838800 4 00010000:00080000:2.0:1790656661.531369:0:14343:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94393b807800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00000100:00100000:1.0:1790656661.531735:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14343:x1877639269797504:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.531745:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790656661.533865:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790656661.535766:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790656661.535809:0:14343:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790656661.535833:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c3a6e82066ebbd6 00000100:00080000:2.0:1790656661.535844:0:14343:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790656661.535855:0:14343:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94393b807800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656661.535891:0:14343:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0e300 x1877639269797632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656661.535914:0:14343:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790656661.536092:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269797632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790656661.536153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.536415:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797632 00000100:00100000:2.0:1790656661.536423:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797632 00000100:00100000:2.0:1790656661.536461:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656661.536468:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1877639269797632:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790656661.536521:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1877639269797632:12345-0@lo:38:llog_process_th.0 Request processed in 52us (367us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790656661.536527:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656661.537164:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790656661.537173:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393b807800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790656661.537178:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790656661.537181:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269797632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790656661.539301:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14343:1877639269797760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656661.539378:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.539416:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656661.539437:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797760 00000100:00100000:2.0:1790656661.539444:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797760 00000100:00100000:2.0:1790656661.539485:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790656661.539494:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14343:x1877639269797760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790656661.539765:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14343:x1877639269797760:12345-0@lo:502:llog_process_th.0 Request processed in 271us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656661.539772:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790656661.539830:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14343:1877639269797760:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790656661.539865:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790656661.541656:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790656661.541682:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790656661.541699:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbc8 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656661.541712:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94393be34c00/0x9c3a6e82066ebbc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbc8 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790656661.541759:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790656661.541761:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.541763:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.541764:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.541765:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.541767:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.541769:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.541770:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.541772:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.541773:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790656661.541776:0:14295:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790656661.541779:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790656661.541780:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.541781:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.541782:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.541783:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.541785:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.541786:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.541787:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.541788:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.541789:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790656661.541810:0:14295:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790656661.541838:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790656661.541893:0:14295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656661.541931:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656661.542138:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269797888 00000100:00100000:0.0:1790656661.542146:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269797888 00000100:00100000:0.0:1790656661.542222:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790656661.542231:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14295:x1877639269797888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790656661.542256:0:14307:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790656661.542268:0:14307:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790656661.618002:0:14307:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790656661.618023:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790656661.618948:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790656661.618953:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790656661.618974:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.618991:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.618999:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.619037:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.619144:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 12 pid: 14308 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656661.619158:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269798016:0@lo:104: 00000100:00100000:3.0:1790656661.619219:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656661.619274:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908cdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656661.619347:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798016 00000100:00100000:0.0:1790656661.619355:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798016 00000100:00100000:0.0:1790656661.619396:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656661.619430:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269798016:12345-0@lo:104: 00010000:00010000:0.0:1790656661.619444:0:14296:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619500:0:14296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656661.619507:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269798016:12345-0@lo:104: Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.619514:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790656661.619536:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656661.619542:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619549:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656661.619554:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619563:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656661.619571:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656661.619577:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790656661.619623:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619640:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656661.619658:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619677:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928481200/0x9c3a6e82066ebba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbac expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619692:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656661.619694:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656661.619696:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656661.619725:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269798144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656661.619752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656661.619803:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798144 00000100:00100000:0.0:1790656661.619808:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798144 00010000:00010000:0.0:1790656661.619836:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 13 pid: 14308 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656661.619857:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656661.619864:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+13:3301:x1877639269798144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656661.619875:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656661.619879:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 13 pid: 14308 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619888:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 13 pid: 14308 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619903:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619911:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790656661.619923:0:14298:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000970360s 00010000:00010000:0.0:1790656661.619933:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619940:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619947:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619954:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619960:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656661.619963:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619971:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619979:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656661.619988:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656661.620015:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+13:3301:x1877639269798144:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656661.620022:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656661.620168:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269798144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656661.620469:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebbac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebba5 expref: 12 pid: 14308 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656661.620480:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269798016:0@lo:104: 00010000:00010000:3.0:1790656661.620494:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.620502:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.620518:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656661.620523:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94393be35c00/0x9c3a6e82066ebbdd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656661.634931:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14295:x1877639269797888:12345-0@lo:253:mount.lustre.0 Request processed in 92692us (93029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656661.634945:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790656661.635130:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14295:1877639269797888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790656661.635157:0:14295:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790656661.635160:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790656661.635162:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790656661.635163:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656661.635165:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656661.635166:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656661.635167:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656661.635169:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790656661.635170:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790656661.635172:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656661.635173:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790656661.635188:0:14295:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790656661.651398:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.651564:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656661.652488:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.653299:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656661.656308:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.656503:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656661.658530:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.658884:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656661.660236:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.660942:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790656661.661866:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790656661.662033:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790656661.743260:0:14295:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790656661.743524:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790656661.743525:0:14353:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1790656661.743530:0:14353:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1790656661.743866:0:14354:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1790656661.743929:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1790656661.748372:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790656661.748493:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1790656661.748507:0:14295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1790656661.748554:0:14354:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790656661.748559:0:14354:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1790656661.750496:0:14295:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790656661.750513:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790656661.754534:0:14295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656661.757403:0:14295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790656661.758214:0:14295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790656661.758254:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790656661.759082:0:14295:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1790656661.760276:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1790656661.766169:0:14295:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790656661.856361:0:14295:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790656661.856402:0:14295:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba9341cc3988 00100000:10000000:1.0:1790656661.856409:0:14295:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790656661.857231:0:14295:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790656661.857245:0:14295:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790656661.857258:0:14295:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790656661.857282:0:14295:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1790656662.369926:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790656662.626320:0:14348:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656662.626332:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790656662.631999:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1790656662.632012:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1790656662.686650:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790656662.686657:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943907838800 from 6 10000000:01000000:0.0:1790656662.686663:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790656662.686716:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656662.686728:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656662.686738:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656662.686762:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269798272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790656662.686843:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656662.686904:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106900 going to sleep for 11 seconds 00000100:00100000:2.0:1790656662.687022:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798272 00000100:00100000:2.0:1790656662.687031:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798272 00000100:00100000:2.0:1790656662.687077:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790656662.687086:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14311:x1877639269798272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656662.687100:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656662.687131:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebbe4 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656662.687193:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656662.687206:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656662.687238:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480800, rc 0) 00000100:00100000:2.0:1790656662.687306:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269798272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656662.687330:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790656662.687506:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269798272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656662.687522:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656662.687533:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656662.687582:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269798400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790656662.687635:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656662.687668:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943903106900 going to sleep for 11 seconds 00000100:00100000:2.0:1790656662.688898:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798400 00000100:00100000:2.0:1790656662.688906:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798400 00000100:00100000:2.0:1790656662.688960:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790656662.688970:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269798400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790656662.688989:0:14307:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790656662.689005:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790656662.689009:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790656662.689110:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269798400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656662.689118:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790656662.689207:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269798400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790656662.689287:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790656662.689311:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656662.689324:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656663.390716:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790656663.648292:0:14348:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790656663.648301:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790656663.648336:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1790656663.648341:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790656664.416040:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656665.439875:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656666.462749:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790656666.789131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790656666.789138:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790656666.789141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790656666.789143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790656666.789146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790656666.789149:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790656666.789153:0:8:0:(import.c:65:import_set_state_nolock()) ffff94393b807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790656666.789175:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94393b807800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656666.789198:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bea7b80 x1877639269798656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790656666.789238:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269798528:0@lo:400:kworker.0 00000100:00100000:1.0:1790656666.789309:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656666.789371:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798528 00000100:00100000:1.0:1790656666.789379:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798528 00000100:00100000:1.0:1790656666.789419:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790656666.789427:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:3302:x1877639269798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656666.789476:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:3302:x1877639269798528:12345-0@lo:400:kworker.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656666.789483:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790656666.789526:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269798528:0@lo:400:kworker.0 00000100:00100000:1.0:1790656666.789547:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269798656:0@lo:38:kworker.0 00000100:00100000:1.0:1790656666.789572:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656666.789629:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798656 00000100:00100000:1.0:1790656666.789634:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798656 00000100:00100000:1.0:1790656666.789653:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790656666.789844:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269798656:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790656666.789865:0:14315:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:1.0:1790656666.789897:0:14315:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c3a6e82066ebbf2 00000004:00100000:1.0:1790656666.789912:0:14315:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790656666.791187:0:14315:0:(import.c:65:import_set_state_nolock()) ffff943908c75800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656666.791270:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1877639269798656:12345-0@lo:38:kworker.0 Request processed in 1423us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656666.791288:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790656666.792576:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393bea7b80 x1877639269798656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790656666.792613:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790656666.792623:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790656666.792628:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790656666.792631:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94393b807800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790656666.792638:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1877639269798656:0@lo:38:kworker.0 00000001:02000400:3.0:1790656666.803034:0:14596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790656667.488925:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656668.512010:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656669.542231:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790656669.646582:0:14747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd345539f0 20000000:00000080:1.0:1790656669.646730:0:14747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94392e942000 uarg=0000000000000000 20000000:01000000:1.0:1790656669.646784:0:14747:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790656669.646794:0:14747:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790656669.646800:0:14747:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790656669.648454:0:14748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1790656669.648873:0:14747:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790656669.656020:0:14747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790656669.656190:0:14747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656669.656215:0:14747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656669.656225:0:14747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656669.656282:0:14747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656669.656301:0:14747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 11 pid: 14307 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656669.656319:0:14747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14747:1877639269798784:0@lo:104: 00000100:00100000:1.0:1790656669.656402:0:14747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656669.656534:0:14747:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c94d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790656669.657409:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798784 00000100:00100000:2.0:1790656669.657421:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798784 00000100:00100000:2.0:1790656669.657533:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656669.657564:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14747:x1877639269798784:12345-0@lo:104: 00010000:00010000:2.0:1790656669.657583:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656669.657708:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790656669.657715:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14747:x1877639269798784:12345-0@lo:104: Request processed in 155us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656669.657722:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790656669.657864:0:14747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14747:1877639269798784:0@lo:104: 00010000:00010000:1.0:1790656669.657891:0:14747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658002:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656669.658010:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658030:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34a00 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656669.658034:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658044:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656669.658052:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656669.658058:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790656669.658125:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658132:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656669.658161:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658168:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94393be34a00/0x9c3a6e82066ebbb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbba expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.658187:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656669.658188:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656669.658190:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656669.658221:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269798912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656669.658267:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656669.658644:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269798912 00000100:00100000:0.0:1790656669.658653:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269798912 00010000:00010000:0.0:1790656669.658685:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 12 pid: 14307 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656669.658720:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656669.658729:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:3299:x1877639269798912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656669.658742:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656669.658747:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 12 pid: 14307 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658768:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 12 pid: 14307 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658785:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebbba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebbb3 expref: 12 pid: 14307 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658816:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658826:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658846:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658855:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658863:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658870:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658876:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656669.658880:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658889:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658907:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656669.658917:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656669.658978:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:3299:x1877639269798912:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656669.658992:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656669.659031:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269798912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656669.659316:0:14747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.659336:0:14747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656669.659342:0:14747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943801f06e00/0x9c3a6e82066ebbf9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656670.560078:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790656670.814975:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790656670.814986:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943907838800 from 10 10000000:01000000:1.0:1790656670.814993:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790656670.815056:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.815071:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.815084:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656670.815117:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790656670.815203:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656670.815517:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c94540 going to sleep for 11 seconds 00000100:00100000:1.0:1790656670.815541:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799040 00000100:00100000:1.0:1790656670.815550:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799040 00000100:00100000:1.0:1790656670.815714:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790656670.815725:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+11:14311:x1877639269799040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656670.815741:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656670.815767:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc00 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.815796:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.815808:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.815830:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07e00, rc 0) 00000100:00100000:1.0:1790656670.815881:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269799040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656670.815889:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790656670.817810:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656670.817848:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656670.817863:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656670.817986:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656670.818076:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656670.818123:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943932d946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656670.818147:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799168 00000100:00100000:3.0:1790656670.818155:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799168 00000100:00100000:3.0:1790656670.818207:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790656670.818218:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269799168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656670.818561:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269799168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656670.818569:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790656670.819731:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790656670.819816:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790656670.819898:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656670.819940:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439280020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656670.820016:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799296 00000100:00100000:1.0:1790656670.820192:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799296 00000100:00100000:1.0:1790656670.820361:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790656670.820373:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269799296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656670.820724:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14311:x1877639269799296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656670.820733:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790656670.820883:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269799296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790656670.833273:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790656670.834212:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790656670.835015:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790656670.835047:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656670.835063:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656671.588262:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656671.903079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269799424:0@lo:400:kworker.0 00000100:00100000:3.0:1790656671.903155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790656671.903330:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656671.903335:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790656671.903338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656671.903341:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790656671.904365:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790656661/real 1790656661] req@ffff94393bd3fb80 x1877639269795968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656671 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656671.904390:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94393bd3fb80 x1877639269795968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656671 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656671.904400:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790656661/real 1790656661] req@ffff94393bd3c380 x1877639269795840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656671 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656671.904412:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94393bd3c380 x1877639269795840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656671 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790656671.904427:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790656671.904440:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790656671.904444:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269795968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790656671.904449:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943928647000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790656671.904454:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790656671.904457:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269795840:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790656671.904497:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790656671.904501:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790656671.904510:0:38:0:(import.c:65:import_set_state_nolock()) ffff943928647000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656671.904515:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 376 00000100:00080000:2.0:1790656671.904530:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790656671.904541:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff943928647000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656671.904565:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0df80 x1877639269799680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790656671.904580:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790656671.904583:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790656671.904585:0:38:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790656671.904602:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 376 00000100:00080000:2.0:1790656671.904605:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790656671.904610:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94390916a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1790656671.904622:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bb0f480 x1877639269799808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790656671.905127:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269799680:0@lo:8:kworker.0 00000400:00000100:2.0:1790656671.905169:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877639269799680 offset 0 length 520: 4 00000100:00100000:2.0:1790656671.905201:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269799808:0@lo:8:kworker.0 00000400:00000100:2.0:1790656671.905220:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877639269799808 offset 0 length 520: 4 00000100:00100000:1.0:1790656671.906020:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799424 00000100:00100000:1.0:1790656671.906029:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799424 00000100:00100000:1.0:1790656671.906294:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269799552:0@lo:400:kworker.0 00000100:00100000:1.0:1790656671.906339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656671.906415:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790656671.906423:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:3300:x1877639269799424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656671.906724:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799552 00000100:00100000:2.0:1790656671.906729:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799552 00000100:00100000:2.0:1790656671.906768:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656671.906774:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269799552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656671.906812:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269799552:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656671.906818:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656671.910238:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:3300:x1877639269799424:12345-0@lo:400:kworker.0 Request processed in 3806us (7073us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656671.910259:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790656671.910382:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393b9e8380 x1877639269799552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656671.910397:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269799552:0@lo:400:kworker.0 00000100:00100000:3.0:1790656671.913235:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269799424:0@lo:400:kworker.0 00010000:00010000:0.0:1790656672.615394:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656673.642525:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790656673.888436:0:14348:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790656673.888447:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656673.888984:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790656673.889043:0:14348:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656673.889074:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000020:01000004:2.0:1790656674.590498:0:14995:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790656674.590503:0:14995:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790656674.590815:0:14995:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94393bc2a800 00000020:01000004:2.0:1790656674.590909:0:14995:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790656674.590931:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790656674.590950:0:14995:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94393c89cd40) 00000020:00000080:2.0:1790656674.590980:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790656674.619426:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790656674.619804:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790656674.621303:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790656674.621559:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790656674.622194:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790656674.622565:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:2.0:1790656674.622701:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 521: rc = 0 00100000:10000000:2.0:1790656674.622940:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 521: rc = 0 00100000:10000000:2.0:1790656674.623443:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 658: rc = 0 00100000:10000000:2.0:1790656674.624170:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 658: rc = 0 00100000:10000000:2.0:1790656674.624455:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 658: rc = 0 00100000:10000000:2.0:1790656674.624770:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 658: rc = 0 00100000:10000000:2.0:1790656674.625248:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 658: rc = 0 00100000:10000000:2.0:1790656674.625513:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 658: rc = 0 00000020:00000080:2.0:1790656674.626809:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790656674.626957:0:14995:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790656674.627045:0:14995:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c3a6e82066ebc15 00000020:01000004:2.0:1790656674.627058:0:14995:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790656674.627085:0:14995:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790656674.627090:0:14995:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790656674.627096:0:14995:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790656674.627101:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790656674.627122:0:14995:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94393c898000) 00000020:00000080:2.0:1790656674.627134:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1790656674.633981:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790656674.634275:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790656674.634282:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790656674.635720:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790656674.635739:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790656674.645258:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790656674.645276:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00010000:00010000:0.0:1790656674.654803:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656674.658358:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656674.658548:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790656674.658555:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790656674.661490:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790656674.661502:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790656674.707346:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790656674.707637:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790656674.707644:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790656674.712558:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790656674.712578:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790656674.714544:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790656674.714555:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790656674.716932:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790656674.717129:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790656674.717135:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790656674.718833:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790656674.718842:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790656674.765078:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790656674.765265:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790656674.765272:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790656674.769305:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790656674.769320:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790656674.770018:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790656674.770041:0:14995:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790656674.770048:0:14995:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790656674.784435:0:14995:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790656674.786654:0:14995:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790656674.786661:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790656674.786663:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790656674.786664:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656674.786665:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656674.786666:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656674.786667:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656674.786668:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790656674.786670:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656674.786671:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656674.786675:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790656674.786678:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790656674.786679:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790656674.786680:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790656674.786681:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790656674.786682:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790656674.786683:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790656674.786684:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790656674.786685:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790656674.786686:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790656674.786718:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790656674.786748:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269799936:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790656674.786836:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.786898:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.787176:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269799936 00000100:00100000:0.0:1790656674.787185:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269799936 00000100:00100000:0.0:1790656674.787240:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790656674.787251:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14995:x1877639269799936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790656674.787296:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790656674.787300:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790656674.787304:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790656674.865818:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14995:x1877639269799936:12345-0@lo:253:mount.lustre.0 Request processed in 78561us (78972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.865832:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790656674.868216:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269799936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790656674.868238:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790656674.868242:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790656674.868243:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790656674.868244:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790656674.868245:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790656674.868247:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790656674.868248:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790656674.868249:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790656674.868251:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790656674.868252:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790656674.868280:0:14995:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94393bc2a800 from lustre-OST0000 10000000:01000000:1.0:1790656674.868307:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790656674.868309:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790656674.868316:0:14995:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff943802ee19c0 local copy 00010000:00010000:1.0:1790656674.868326:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656674.868583:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656674.868687:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.868737:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439089df300 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.868932:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800064 00000100:00100000:0.0:1790656674.868938:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800064 00000100:00100000:0.0:1790656674.868983:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790656674.868991:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14995:x1877639269800064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656674.869174:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14995:x1877639269800064:12345-0@lo:501:mount.lustre.0 Request processed in 182us (485us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790656674.869193:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790656674.869434:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800064:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790656674.869451:0:14995:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790656674.869620:0:14995:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790656674.869628:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.869639:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656674.869661:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94393bc2a800 10000000:01000000:1.0:1790656674.869666:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790656674.869670:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff943802ee19c0 10000000:01000000:1.0:1790656674.869673:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790656674.869676:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff943802ee19c0 from 1 10000000:01000000:1.0:1790656674.869679:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790656674.869703:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.869713:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.869733:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656674.869749:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790656674.869942:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.869982:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439089df300 going to sleep for 11 seconds 00000100:00100000:2.0:1790656674.870256:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800192 00000100:00100000:2.0:1790656674.870263:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800192 00000100:00100000:2.0:1790656674.870301:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790656674.870310:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+12:14995:x1877639269800192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656674.870320:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656674.870333:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480e00/0x9c3a6e82066ebc2a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc23 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.870355:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480e00/0x9c3a6e82066ebc2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc23 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.870367:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480e00/0x9c3a6e82066ebc2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc23 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.870375:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480e00, rc 0) 00000100:00100000:2.0:1790656674.870422:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+13:14995:x1877639269800192:12345-0@lo:101:mount.lustre.0 Request processed in 114us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656674.870429:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790656674.870535:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656674.870547:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc2a expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.870555:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc2a expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656674.870578:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790656674.870736:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc2a expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.870745:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943801f07c00/0x9c3a6e82066ebc23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc2a expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656674.870752:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790656674.870757:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790656674.870762:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790656674.870764:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790656674.870852:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.870860:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.870868:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656674.870883:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790656674.870988:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.871237:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439089df300 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.871433:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800320 00000100:00100000:0.0:1790656674.871439:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800320 00000100:00100000:0.0:1790656674.871506:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790656674.871514:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+13:14995:x1877639269800320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656674.871523:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656674.871534:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b507c00/0x9c3a6e82066ebc38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc31 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656674.871561:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b507c00/0x9c3a6e82066ebc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc31 expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656674.871570:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b507c00/0x9c3a6e82066ebc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc31 expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656674.871577:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507c00, rc 0) 00000100:00100000:0.0:1790656674.871681:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800320:12345-0@lo:101:mount.lustre.0 Request processed in 167us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.871687:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790656674.871886:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656674.871899:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc38 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.871973:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc38 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790656674.873463:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790656674.875421:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656674.882022:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790656674.882113:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790656674.882146:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790656674.882191:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790656674.882253:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790656674.882287:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790656674.882363:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790656674.882371:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790656674.882473:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656674.882553:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.882630:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.882648:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800448 00000100:00100000:1.0:1790656674.882657:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800448 00000100:00100000:1.0:1790656674.882697:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790656674.882706:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656674.885426:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800448:12345-0@lo:501:mount.lustre.0 Request processed in 2714us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.885441:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790656674.885816:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656674.885873:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790656674.885947:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.885984:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.886184:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800576 00000100:00100000:0.0:1790656674.886191:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800576 00000100:00100000:0.0:1790656674.886261:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790656674.886269:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656674.886666:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800576:12345-0@lo:503:mount.lustre.0 Request processed in 397us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.886683:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790656674.886791:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790656674.887817:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790656674.887889:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790656674.887954:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.887991:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.888024:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800704 00000100:00100000:1.0:1790656674.888031:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800704 00000100:00100000:1.0:1790656674.888078:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790656674.888087:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656674.888286:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800704:12345-0@lo:502:mount.lustre.0 Request processed in 199us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.888294:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790656674.888391:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790656674.888623:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790656674.888667:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790656674.888698:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790656674.888767:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790656674.888819:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790656674.888853:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790656674.888896:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790656674.888942:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790656674.888978:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790656674.889351:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790656674.889398:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790656674.889451:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790656674.889486:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790656674.889537:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.889565:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.889745:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800832 00000100:00100000:0.0:1790656674.889751:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800832 00000100:00100000:0.0:1790656674.889800:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790656674.889809:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656674.890340:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800832:12345-0@lo:502:mount.lustre.0 Request processed in 532us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.890348:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790656674.890452:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790656674.890525:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790656674.890541:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1790656674.893283:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790656674.893300:0:15011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790656674.893306:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656674.893309:0:15011:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790656674.893316:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656674.893332:0:15011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94392810cd40) 00000020:00000080:0.0:1790656674.893353:0:15011:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790656674.893360:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790656674.893559:0:15011:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94393bc2a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790656674.893568:0:15011:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790656674.893643:0:15011:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c3a6e82066ebc46 00010000:00010000:1.0:1790656674.899087:0:15011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790656674.899461:0:15011:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1790656674.903826:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790656674.906458:0:15011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790656674.906470:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.906478:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906480:0:15011:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790656674.906484:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790656674.906487:0:15011:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790656674.906489:0:15011:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790656674.906491:0:15011:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790656674.906504:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790656674.906507:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906508:0:15011:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790656674.906511:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656674.906514:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906516:0:15011:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790656674.906519:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790656674.906521:0:15011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790656674.906523:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.906525:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906527:0:15011:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790656674.906529:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656674.906531:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906533:0:15011:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790656674.906536:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790656674.906670:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.906674:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.906676:0:15011:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790656674.906679:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1790656674.911887:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1790656674.911943:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790656674.911962:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc38 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.911991:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943801f07000/0x9c3a6e82066ebc31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc38 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656674.912029:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94393bc2a800 from 1 10000000:01000000:2.0:1790656674.912032:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790656674.912069:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.912076:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.912086:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656674.912110:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656674.912179:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.915069:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.915167:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269800960 00000100:00100000:1.0:1790656674.915177:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269800960 00000100:00100000:1.0:1790656674.915233:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790656674.915243:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+14:14995:x1877639269800960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656674.915259:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656674.915276:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc4d expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.915301:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.915311:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.915331:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07a00, rc 0) 00000100:00100000:1.0:1790656674.915456:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269800960:12345-0@lo:101:mount.lustre.0 Request processed in 214us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.915462:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790656674.918236:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269800960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656674.918263:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656674.918276:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656674.919116:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790656674.920124:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656674.920375:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790656674.920430:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790656674.920491:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790656674.920500:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790656674.920574:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656674.921496:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.921544:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.921640:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801088 00000100:00100000:1.0:1790656674.921649:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801088 00000100:00100000:1.0:1790656674.921702:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790656674.921711:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656674.922052:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801088:12345-0@lo:501:mount.lustre.0 Request processed in 340us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.922059:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790656674.922188:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656674.922228:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656674.922266:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.922293:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656674.922343:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801216 00000100:00100000:3.0:1790656674.922348:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801216 00000100:00100000:3.0:1790656674.922379:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790656674.922386:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790656674.922529:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801216:12345-0@lo:503:mount.lustre.0 Request processed in 142us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656674.922536:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790656674.922664:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790656674.923416:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790656674.923473:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656674.923515:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.923545:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e1619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656674.924002:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801344 00000100:00100000:3.0:1790656674.924008:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801344 00000100:00100000:3.0:1790656674.924051:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790656674.924060:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790656674.924226:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801344:12345-0@lo:502:mount.lustre.0 Request processed in 166us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656674.924233:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790656674.924324:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790656674.924558:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790656674.924635:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790656674.924759:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790656674.924801:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790656674.924832:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790656674.924878:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790656674.924927:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790656674.924960:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790656674.924988:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656674.925028:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.925059:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790656674.925341:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801472 00000100:00100000:3.0:1790656674.925348:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801472 00000100:00100000:3.0:1790656674.925384:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790656674.925392:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790656674.925524:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801472:12345-0@lo:502:mount.lustre.0 Request processed in 132us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656674.925536:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790656674.925982:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790656674.926074:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790656674.926092:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790656674.927151:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656674.927161:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927164:0:15015:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790656674.927170:0:15015:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94393bc2a800 00000020:00000080:1.0:1790656674.927172:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790656674.927179:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.927182:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927183:0:15015:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790656674.927185:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656674.927187:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927189:0:15015:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790656674.927192:0:15015:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94393bc2a800 00000020:00000080:1.0:1790656674.927194:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790656674.927283:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.927288:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927289:0:15015:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790656674.927292:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790656674.927295:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927296:0:15015:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790656674.927299:0:15015:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94393bc2a800 00000020:00000080:1.0:1790656674.927302:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790656674.927842:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790656674.927847:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790656674.927849:0:15015:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790656674.927852:0:15015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790656674.928006:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790656674.928029:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790656674.928051:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.928062:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790656674.928103:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790656674.928106:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94393bc2a800 10000000:01000000:2.0:1790656674.928109:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94393bc2a800 10000000:01000000:2.0:1790656674.928113:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790656674.928128:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94393bc2a800 from 1 10000000:01000000:2.0:1790656674.928131:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790656674.928163:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.928171:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.928181:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656674.928202:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790656674.928259:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.928295:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.928348:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801600 00000100:00100000:1.0:1790656674.928355:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801600 00000100:00100000:1.0:1790656674.928393:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790656674.928401:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269801600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656674.928412:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656674.928423:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f07400/0x9c3a6e82066ebc62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc5b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.928450:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f07400/0x9c3a6e82066ebc62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc5b expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.928460:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f07400/0x9c3a6e82066ebc62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc5b expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656674.928468:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07400, rc 0) 00000100:00100000:1.0:1790656674.928503:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801600:12345-0@lo:101:mount.lustre.0 Request processed in 103us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.928509:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790656674.928631:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656674.928644:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc62 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.928652:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc62 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656674.930349:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790656674.930669:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790656674.933231:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790656674.933286:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790656674.933339:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790656674.933388:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790656674.933426:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790656674.933490:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790656674.933530:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790656674.933576:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790656674.933662:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790656674.934288:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790656674.934330:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790656674.934377:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790656674.934409:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790656674.934438:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790656674.934482:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790656674.934514:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790656674.934541:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790656674.934583:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790656674.934655:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790656674.934817:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790656674.934882:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790656674.934918:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790656674.934954:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790656674.935016:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790656674.935055:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790656674.935091:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790656674.935139:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790656674.935177:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790656674.935261:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790656674.935269:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790656674.935364:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656674.935429:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.935520:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656674.936318:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801728 00000100:00100000:1.0:1790656674.936327:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801728 00000100:00100000:1.0:1790656674.936382:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790656674.936391:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656674.936653:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801728:12345-0@lo:501:mount.lustre.0 Request processed in 263us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.936661:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790656674.938867:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656674.938923:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656674.938988:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.939028:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.939100:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801856 00000100:00100000:0.0:1790656674.939107:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801856 00000100:00100000:0.0:1790656674.939156:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790656674.939165:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656674.939339:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801856:12345-0@lo:503:mount.lustre.0 Request processed in 175us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.939347:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790656674.939630:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790656674.940298:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790656674.940364:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656674.940421:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.940494:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908f7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.949795:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269801984 00000100:00100000:0.0:1790656674.949810:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269801984 00000100:00100000:0.0:1790656674.949861:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790656674.949870:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656674.950159:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269801984:12345-0@lo:502:mount.lustre.0 Request processed in 288us (9737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.950167:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790656674.950236:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269801984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790656674.950504:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790656674.950551:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790656674.950579:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790656674.950648:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790656674.950683:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790656674.950870:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790656674.950907:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790656674.950940:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790656674.950986:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790656674.951022:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790656674.951056:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790656674.951103:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790656674.951140:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790656674.951187:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790656674.951247:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790656674.951284:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790656674.951314:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790656674.951361:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790656674.951394:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790656674.951422:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790656674.951467:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790656674.951500:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790656674.951531:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790656674.951575:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790656674.951641:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1790656674.951673:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1790656674.951745:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1790656674.951779:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1790656674.951810:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1790656674.951868:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1790656674.951900:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1790656674.951932:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1790656674.951966:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1790656674.952014:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1790656674.952049:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1790656674.952096:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1790656674.952134:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1790656674.952165:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1790656674.952210:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1790656674.952248:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1790656674.952293:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269802112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656674.952360:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.952405:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392e161b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.952432:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802112 00000100:00100000:0.0:1790656674.952439:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802112 00000100:00100000:0.0:1790656674.952479:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790656674.952488:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269802112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656674.952702:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269802112:12345-0@lo:502:mount.lustre.0 Request processed in 214us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656674.952708:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790656674.958729:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269802112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790656674.958878:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790656674.958893:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790656674.961821:0:15020:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790656674.961838:0:15020:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9439281099c0) 00000020:00000080:0.0:1790656674.961858:0:15020:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1790656674.961944:0:15020:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94393bc2a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790656674.961948:0:15020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94393bc2a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790656674.961951:0:15020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94393bc2a800 3 00010000:00080000:0.0:1790656674.961985:0:15020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943802a62000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1790656674.963562:0:15020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1790656674.963798:0:15020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790656674.963828:0:15020:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790656674.963841:0:15020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c3a6e82066ebc70 00000100:00080000:0.0:1790656674.963850:0:15020:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790656674.963861:0:15020:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff943802a62000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1790656674.963894:0:15020:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393b9e8e00 x1877639269802240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790656674.963923:0:15020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790656674.964098:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790656674.964103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790656674.964105:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790656674.964109:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790656674.964153:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269802368:0@lo:400:kworker.0 00000100:00100000:1.0:1790656674.964218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656674.964270:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802368 00000100:00100000:1.0:1790656674.964277:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802368 00000100:00100000:1.0:1790656674.964327:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790656674.964337:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269802368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656674.964385:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269802368:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656674.964392:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790656674.964429:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393bd3d880 x1877639269802368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656674.964442:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269802368:0@lo:400:kworker.0 00000100:00100000:3.0:1790656674.964749:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269802240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790656674.964783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656674.966691:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802240 00000100:00100000:2.0:1790656674.966701:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802240 00000100:00100000:2.0:1790656674.966747:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656674.966754:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1877639269802240:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790656674.966780:0:14315:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:2.0:1790656674.966819:0:14315:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c3a6e82066ebc77 00000004:00100000:2.0:1790656674.966833:0:14315:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790656674.966864:0:14315:0:(import.c:65:import_set_state_nolock()) ffff94392dadb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656674.966936:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1877639269802240:12345-0@lo:38:llog_process_th.0 Request processed in 181us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656674.966944:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790656674.966995:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94393b9e8e00 x1877639269802240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656674.967006:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790656674.967013:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790656674.967020:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790656674.967024:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790656674.967026:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943802a62000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790656674.967031:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1877639269802240:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790656674.968481:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790656674.968749:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790656674.968776:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790656674.968790:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc62 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656674.968802:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480a00/0x9c3a6e82066ebc5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc62 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790656674.968848:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790656674.968851:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790656674.968852:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656674.968854:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656674.968855:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656674.968856:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656674.968857:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656674.968859:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656674.968861:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656674.968864:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790656674.968867:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790656674.968868:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790656674.968869:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656674.968874:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656674.968875:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656674.968876:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656674.968877:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656674.968878:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656674.968879:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656674.968900:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790656674.968917:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269802496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790656674.968977:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656674.969013:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790656674.969039:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802496 00000100:00100000:0.0:1790656674.969045:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802496 00000100:00100000:0.0:1790656674.969082:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790656674.969089:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14995:x1877639269802496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790656674.969113:0:14307:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790656674.969124:0:14307:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790656674.989955:0:14307:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790656674.989974:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790656674.990063:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790656674.990068:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790656674.990088:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990104:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990112:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990151:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990166:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 16 pid: 14308 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656674.990197:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269802624:0@lo:104: 00000100:00100000:3.0:1790656674.990266:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656674.990314:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909b54f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656674.990367:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802624 00000100:00100000:2.0:1790656674.990374:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802624 00000100:00100000:2.0:1790656674.990419:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790656674.990428:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269802624:12345-0@lo:104: 00010000:00010000:2.0:1790656674.990441:0:14296:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656674.990489:0:14296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790656674.990494:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269802624:12345-0@lo:104: Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656674.990501:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790656674.990853:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656674.990860:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990868:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656674.990872:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990880:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656674.990887:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656674.990893:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790656674.990924:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990931:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656674.990953:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990961:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff94393b507800/0x9c3a6e82066ebbe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebbeb expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.990975:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656674.990984:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656674.990986:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656674.990998:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656674.991009:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269802752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790656674.991041:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656674.991071:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802752 00000100:00100000:3.0:1790656674.991075:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802752 00010000:00010000:3.0:1790656674.991093:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 17 pid: 14308 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656674.991114:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656674.991120:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:3300:x1877639269802752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656674.991130:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656674.991135:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 17 pid: 14308 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991145:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 17 pid: 14308 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991161:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991168:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790656674.991180:0:14300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001113107s 00010000:00010000:3.0:1790656674.991184:0:14300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991191:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991207:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991214:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991219:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656674.991222:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991229:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991237:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991246:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656674.991276:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:3300:x1877639269802752:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656674.991284:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656674.991320:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269802752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656674.991342:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928480800/0x9c3a6e82066ebbeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebbe4 expref: 16 pid: 14308 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656674.991351:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269802624:0@lo:104: 00010000:00010000:3.0:1790656674.991361:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991378:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991384:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656674.991390:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94393be34000/0x9c3a6e82066ebc7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656675.001318:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14995:x1877639269802496:12345-0@lo:253:mount.lustre.0 Request processed in 32220us (32332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656675.001333:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790656675.001417:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14995:1877639269802496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790656675.001432:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790656675.001435:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790656675.001437:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790656675.001438:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656675.001440:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656675.001441:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656675.001442:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656675.001444:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656675.001445:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656675.001446:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790656675.001460:0:14995:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790656675.005582:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790656675.006107:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790656675.006267:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790656675.006416:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790656675.006561:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790656675.006877:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790656675.007549:0:14995:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790656675.053058:0:14995:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790656675.053067:0:14995:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790656675.053099:0:14995:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790656675.053151:0:14995:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790656675.053164:0:14995:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790656675.053191:0:14995:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790656675.683003:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790656676.382857:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790656676.382864:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943907838800 from 7 10000000:01000000:2.0:1790656676.382868:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790656676.382911:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656676.382923:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656676.382934:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656676.382958:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269802880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656676.383028:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656676.383084:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656676.383134:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269802880 00000100:00100000:0.0:1790656676.383143:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269802880 00000100:00100000:0.0:1790656676.383189:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790656676.383212:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+15:14311:x1877639269802880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656676.383225:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656676.383237:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebc85 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656676.383258:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656676.383269:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656676.383277:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b507000, rc 0) 00000100:00100000:0.0:1790656676.383360:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14311:x1877639269802880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656676.383366:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790656676.391397:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269802880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656676.391428:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656676.391441:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656676.391519:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269803008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790656676.391740:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656676.391778:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656676.391845:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803008 00000100:00100000:0.0:1790656676.391852:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803008 00000100:00100000:0.0:1790656676.391902:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790656676.391911:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14311:x1877639269803008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790656676.391930:0:14307:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790656676.391946:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790656676.391949:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790656676.392045:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14311:x1877639269803008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656676.392052:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790656676.392131:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269803008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790656676.392189:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790656676.392197:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656676.392206:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656676.702763:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656677.730661:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656678.750966:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656679.774783:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790656680.100449:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656680.100456:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790656680.100466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656680.100469:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790656680.100528:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269803136:0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.100631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656680.100706:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269803264:0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.100734:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656680.100755:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656680.100761:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269803392:0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.100785:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656680.100814:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803136 00000100:00100000:0.0:1790656680.100821:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803136 00000100:00100000:0.0:1790656680.100862:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790656680.100871:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3300:x1877639269803136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.100917:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3300:x1877639269803136:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656680.100924:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790656680.100959:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803264 00000100:00100000:0.0:1790656680.100964:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803264 00000100:00100000:0.0:1790656680.100986:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803392 00000100:00100000:0.0:1790656680.100988:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803392 00000100:00100000:0.0:1790656680.101012:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790656680.101018:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269803264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.101053:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269803264:12345-0@lo:400:kworker.0 Request processed in 35us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656680.101059:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790656680.101071:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656680.101086:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656680.101115:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269803392:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656680.101120:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656680.101158:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269803136:0@lo:400:kworker.0 00010000:00080000:0.0:1790656680.101188:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9ead80 x1877639269803392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656680.101198:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269803392:0@lo:400:kworker.0 00010000:00080000:0.0:1790656680.101206:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9ebb80 x1877639269803264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656680.101213:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269803264:0@lo:400:kworker.0 00000100:00080000:0.0:1790656680.101258:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790656680.799356:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790656680.854635:0:15362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790656681.823777:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656682.846747:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790656683.103314:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790656683.876635:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656684.899504:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790656685.222432:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790656685.222437:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790656685.222440:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790656685.222443:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790656685.222490:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269803648:0@lo:400:kworker.0 00000100:00100000:2.0:1790656685.222740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656685.222797:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790656685.222804:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269803520:0@lo:400:kworker.0 00000100:00100000:2.0:1790656685.222835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656685.222869:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269803776:0@lo:400:kworker.0 00000100:00100000:2.0:1790656685.222893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656685.222924:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803648 00000100:00100000:3.0:1790656685.223655:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803776 00000100:00100000:3.0:1790656685.223661:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803776 00000100:00100000:3.0:1790656685.223717:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656685.223726:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656685.223785:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269803776:12345-0@lo:400:kworker.0 Request processed in 60us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656685.223793:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790656685.223815:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803520 00000100:00100000:3.0:1790656685.223818:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803520 00000100:00100000:3.0:1790656685.223922:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790656685.223928:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3300:x1877639269803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656685.224103:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803648 00000100:00100000:2.0:1790656685.224136:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790656685.224142:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269803648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656685.224180:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269803648:12345-0@lo:400:kworker.0 Request processed in 37us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656685.224186:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790656685.224220:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bb0f100 x1877639269803776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656685.224241:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269803776:0@lo:400:kworker.0 00010000:00080000:2.0:1790656685.224274:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bb0d880 x1877639269803648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790656685.224283:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269803648:0@lo:400:kworker.0 00000100:00100000:3.0:1790656685.224520:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3300:x1877639269803520:12345-0@lo:400:kworker.0 Request processed in 591us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656685.224527:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1790656685.224560:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656685.226424:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269803520:0@lo:400:kworker.0 00010000:00010000:3.0:1790656685.919964:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656686.238720:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790656671/real 1790656671] req@ffff94393bb0df80 x1877639269799680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656686 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656686.238751:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94393bb0df80 x1877639269799680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656686 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656686.238761:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790656671/real 1790656671] req@ffff94393bb0f480 x1877639269799808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656686 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790656686.238773:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94393bb0f480 x1877639269799808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790656686 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790656686.238792:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943928647000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790656686.238812:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790656686.238900:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269799680:0@lo:8:kworker.0 00000100:00080000:3.0:1790656686.238906:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790656686.238913:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790656686.238916:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269799808:0@lo:8:kworker.0 00000100:00100000:2.0:1790656686.239097:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269803904:0@lo:400:kworker.0 00000100:00100000:2.0:1790656686.239166:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656686.241031:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269803904 00000100:00100000:3.0:1790656686.241045:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269803904 00000100:00100000:3.0:1790656686.241106:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790656686.241116:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3302:x1877639269803904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790656686.241928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656686.241934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790656686.241937:0:37:0:(import.c:65:import_set_state_nolock()) ffff943928647000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790656686.241942:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790656686.241947:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790656686.241956:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff943928647000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1790656686.241985:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393b9ead80 x1877639269804032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790656686.242005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790656686.242008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790656686.242010:0:37:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790656686.242013:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790656686.242021:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790656686.242026:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94390916a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1790656686.242037:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393b9e9c00 x1877639269804160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790656686.242092:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269804288:0@lo:400:kworker.0 00000100:00100000:0.0:1790656686.242131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656686.242166:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656686.242172:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269804416:0@lo:400:kworker.0 00000100:00100000:0.0:1790656686.242192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656686.242221:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804288 00000100:00100000:0.0:1790656686.242227:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804288 00000100:00100000:0.0:1790656686.242259:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804416 00000100:00100000:0.0:1790656686.242262:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804416 00000100:00100000:0.0:1790656686.242276:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656686.242283:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269804288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656686.242323:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269804288:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656686.242330:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656686.242348:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656686.242355:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269804416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656686.242384:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877639269804416:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656686.242389:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790656686.242429:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9e8a80 x1877639269804416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656686.242442:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1877639269804416:0@lo:400:kworker.0 00010000:00080000:0.0:1790656686.242463:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9e8700 x1877639269804288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656686.242471:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269804288:0@lo:400:kworker.0 00000100:00100000:0.0:1790656686.242495:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269804032:0@lo:8:kworker.0 00000100:00100000:0.0:1790656686.242523:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656686.242549:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269804160:0@lo:8:kworker.0 00000100:00100000:0.0:1790656686.242568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656686.242623:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804032 00000100:00100000:0.0:1790656686.242627:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804032 00000100:00100000:0.0:1790656686.242653:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804160 00000100:00100000:0.0:1790656686.242656:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804160 00000100:00100000:0.0:1790656686.242665:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656686.242670:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1877639269804032:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790656686.242691:0:14996:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1790656686.242716:0:14996:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ebc93 00002000:00100000:0.0:1790656686.242727:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff943802a66800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790656686.242731:0:14996:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790656686.242734:0:14996:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790656686.243073:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790656686.243095:0:14996:0:(import.c:65:import_set_state_nolock()) ffff943802a60800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656686.243137:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1877639269804032:12345-0@lo:8:kworker.0 Request processed in 466us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656686.243144:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656686.243161:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656686.243165:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1877639269804160:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790656686.243185:0:14996:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790656686.243212:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1877639269804160:12345-0@lo:8:kworker.0 Request processed in 46us (642us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790656686.243217:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790656686.243246:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9ead80 x1877639269804032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790656706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656686.243254:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790656686.243262:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790656686.243270:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790656686.243275:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790656686.243278:0:3298:0:(import.c:65:import_set_state_nolock()) ffff943928647000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790656686.243294:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790656686.243299:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269804032:0@lo:8:kworker.0 00000100:00080000:0.0:1790656686.243311:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790656686.243314:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790656686.243318:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269804160:0@lo:8:kworker.0 00000100:00100000:3.0:1790656686.247036:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3302:x1877639269803904:12345-0@lo:400:kworker.0 Request processed in 5912us (7860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656686.247050:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1790656686.247114:0:14335:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790656686.249189:0:14335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401385596419ns, next at 0ns, rc = 0 00000004:00080000:0.0:1790656686.249753:0:14336:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1790656686.249797:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1877639269804672:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790656686.249873:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656686.249911:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392861f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790656686.249929:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269804544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656686.249955:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656686.250347:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804672 00000100:00100000:3.0:1790656686.250354:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804672 00000100:00100000:3.0:1790656686.250412:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656686.250420:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14336:x1877639269804672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790656686.251218:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804544 00000100:00100000:1.0:1790656686.251225:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804544 00000100:00100000:1.0:1790656686.251273:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656686.251283:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269804544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790656686.251314:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656686.251395:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269804544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656686.251401:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790656686.253776:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790656686.253851:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393b9e9c00 x1877639269804544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656686.253900:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269804544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656686.256329:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269803904:0@lo:400:kworker.0 00002000:00080000:3.0:1790656686.266730:0:14996:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790656686.266741:0:14996:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790656686.266746:0:14996:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1790656686.286273:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.286286:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286304:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.286309:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.286325:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286345:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286356:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286364:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286384:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.286399:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.286405:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286413:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.286418:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286428:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286444:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286463:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebc9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.286483:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.286485:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.286487:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.287002:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.287009:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287018:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.287021:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.287025:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287035:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287042:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287049:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287066:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.287076:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.287087:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287094:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.287098:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287106:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287118:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287126:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287141:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.287143:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.287145:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.287542:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.287549:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287557:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.287560:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.287563:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287584:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287622:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.287631:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.291397:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.291415:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.291423:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.291434:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.291439:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.291450:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.291470:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.291478:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000208cb89f/0x9c3a6e82066ebca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.294683:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.294690:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.294693:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.295379:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.295389:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295404:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.295408:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.295414:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295426:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295436:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295442:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295460:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.295471:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.295475:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295857:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.295862:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295871:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295890:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295897:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e21421/0x9c3a6e82066ebcaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.295914:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.295916:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.295918:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.297050:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.297060:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297071:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.297075:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.297081:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297092:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297108:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297116:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297132:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.297143:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.297147:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297155:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.297158:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297166:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297179:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297186:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009428a8b0/0x9c3a6e82066ebcb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.297202:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.297209:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.297211:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.301224:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.301236:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301253:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.301258:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.301263:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301277:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301286:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301293:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301312:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.301325:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.301330:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301337:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.301340:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301361:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301378:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301386:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc07779/0x9c3a6e82066ebcbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301405:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.301407:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.301409:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.301888:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.301896:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301906:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.301910:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.301914:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301924:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301932:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301945:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301961:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.301971:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.301976:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301983:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.301987:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.301995:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302006:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302013:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5435b5f/0x9c3a6e82066ebcc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302026:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.302028:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.302030:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.302416:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.302429:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302439:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.302442:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.302446:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302456:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302463:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302469:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302482:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.302491:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.302494:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302501:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.302504:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302510:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302527:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302534:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008222a151/0x9c3a6e82066ebccb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.302546:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.302548:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.302550:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.303319:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.303327:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303337:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.303340:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.303344:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303355:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303363:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303369:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303399:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656686.303411:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656686.303415:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303423:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656686.303426:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303434:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303447:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303453:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea5fd92/0x9c3a6e82066ebcd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.303469:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.303470:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.303472:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.305716:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.305729:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.305745:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.305755:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.305762:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.305776:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.305785:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.305794:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.307145:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.307368:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.307381:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.307393:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.307397:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.307408:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.307430:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.307438:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f22848/0x9c3a6e82066ebcd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.307460:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.307462:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.307463:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.310437:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.310452:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.310469:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.310473:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.310479:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.310493:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.310505:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.310520:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.310546:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.311360:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.311369:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.311380:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.311384:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.311405:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.311423:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.311430:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2efed36/0x9c3a6e82066ebce0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.311452:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.311453:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.311455:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790656686.312334:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790656686.313398:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.313407:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.313423:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.313427:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.313433:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.313445:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.313454:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.313462:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.313509:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790656686.313958:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.313964:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.314014:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.314017:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.314021:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.314031:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.314039:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.314045:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317358:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790656686.317372:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317385:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.317389:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317399:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317420:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317442:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3acedd/0x9c3a6e82066ebce7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317465:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.317469:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317475:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.317478:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317486:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317497:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.317504:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.317505:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.317507:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.317954:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790656686.317962:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9d61aa/0x9c3a6e82066ebcee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656686.318724:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.318733:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.318745:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.318749:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.318755:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.318777:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.318785:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.318792:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.323500:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.323515:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.323529:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.323541:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.323552:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.323571:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.323581:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.323583:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.323585:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.324485:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790656686.324584:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009837a21a/0x9c3a6e82066ebcf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.324694:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.325410:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.325418:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.325432:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.325436:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.325442:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.325455:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.325477:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.325485:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.325615:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.325623:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.325629:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.325647:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be34400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.325651:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.325661:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.325676:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.325685:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005160e9d6/0x9c3a6e82066ebcfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.325705:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.325707:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.325708:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.326078:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.326084:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326092:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.326095:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.326099:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326107:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326115:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326120:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326148:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790656686.326810:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.326817:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326827:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.326830:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.326834:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326843:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326851:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326858:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.326873:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790656686.326922:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790656686.326928:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.326935:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393be35800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.326947:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.326956:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.326970:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.326978:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b078c6f0/0x9c3a6e82066ebd03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.326994:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.326997:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.327004:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.327013:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.327021:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.327032:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.327039:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ebd0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.327051:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.327052:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.327054:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.327060:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.330539:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.330552:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.330568:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.330578:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.330585:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.330616:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.330628:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.330646:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.330667:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.331364:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.331372:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331381:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.331385:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331394:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331412:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331425:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ebd11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331442:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.331445:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.331446:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.331482:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.331498:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.331508:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.331512:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.331516:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.331526:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.331535:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.331546:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.331567:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.331622:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.331627:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331645:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.331649:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331658:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331669:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331676:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397ffb0e/0x9c3a6e82066ebd18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.331688:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.331690:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.331692:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.332398:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.332406:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332414:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.332417:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.332421:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332431:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332440:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332446:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332467:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.332488:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.332500:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.332508:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.332512:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.332520:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.332538:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.332546:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017533364/0x9c3a6e82066ebd1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.332566:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.332568:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.332570:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.332957:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.332963:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332977:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.332980:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.332984:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.332993:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333002:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333009:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333028:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.333071:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.333076:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333084:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.333088:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333106:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333119:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333126:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f4d0eb/0x9c3a6e82066ebd26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333139:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.333141:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.333143:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.333580:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.333587:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333617:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.333620:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.333624:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333642:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333663:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333671:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.333692:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.333902:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.333908:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333916:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.333920:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333927:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333947:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333966:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addcc0a1/0x9c3a6e82066ebd2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.333980:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.333982:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.333984:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.334241:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.334248:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334257:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.334259:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.334263:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334272:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334280:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334287:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334319:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.334425:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.334437:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334445:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.334448:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334456:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334474:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334482:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ee2c138/0x9c3a6e82066ebd34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334502:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.334504:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.334506:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.334795:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.334801:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334809:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.334812:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.334816:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334825:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334833:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334839:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.334859:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656686.334905:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.334910:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334918:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.334920:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.334935:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.335019:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.335027:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b7600e/0x9c3a6e82066ebd3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.335042:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.335043:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.335045:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.335394:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.335400:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.335408:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.335416:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.335421:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.335430:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.335439:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.335446:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.335560:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790656686.336108:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.336116:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.336126:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.336130:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.336134:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.336144:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.336153:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.336165:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336585:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790656686.336602:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336611:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.336615:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336634:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336660:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336668:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ebd42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336688:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.336692:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336698:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.336701:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336709:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336718:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.336726:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.336727:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.336734:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656686.336803:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790656686.336809:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006815ecf6/0x9c3a6e82066ebd49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.337280:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656686.337391:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790656686.337398:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.337407:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790656686.337410:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656686.337415:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.337424:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.337433:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.337440:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656686.337557:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790656686.337806:0:14996:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1790656686.337902:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14336:x1877639269804672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 87479us (88025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656686.337912:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656686.337968:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1877639269804672:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790656686.337983:0:14336:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1790656686.338028:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1877639269804800:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790656686.338062:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656686.338098:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908a01f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790656686.338118:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804800 00000100:00100000:3.0:1790656686.338124:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804800 00000100:00100000:3.0:1790656686.338158:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656686.338166:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14336:x1877639269804800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790656686.338274:0:14999:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1790656686.341300:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656686.341312:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.341325:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656686.341331:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.341343:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.341363:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.341371:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e009d497/0x9c3a6e82066ebd50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656686.341390:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.341392:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656686.341394:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656686.343197:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14336:x1877639269804800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5024us (5128us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790656686.343208:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790656686.343262:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1877639269804800:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790656686.343277:0:14336:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1790656686.943527:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790656687.914237:0:15712:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790656687.914241:0:15712:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790656687.914347:0:15712:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff943802a64800 00000020:01000004:0.0:1790656687.914363:0:15712:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790656687.914387:0:15712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790656687.914401:0:15712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff943928108000) 00000020:00000080:0.0:1790656687.914418:0:15712:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790656687.933969:0:15712:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790656687.934244:0:15712:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790656687.937513:0:15712:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790656687.938848:0:15712:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790656687.939088:0:15712:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790656687.940264:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 437: rc = 0 00100000:10000000:1.0:1790656687.940632:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 437: rc = 0 00100000:10000000:1.0:1790656687.940778:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 437: rc = 0 00100000:10000000:1.0:1790656687.941622:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 97: rc = 0 00100000:10000000:1.0:1790656687.941896:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 97: rc = 0 00100000:10000000:1.0:1790656687.942543:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 97: rc = 0 00100000:10000000:1.0:1790656687.942869:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 97: rc = 0 00100000:10000000:1.0:1790656687.945389:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 97: rc = 0 00100000:10000000:1.0:1790656687.946800:0:15712:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 97: rc = 0 00000020:00000080:1.0:1790656687.950954:0:15712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790656687.950967:0:15712:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790656687.950979:0:15712:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c3a6e82066ebd5e 00000020:01000004:1.0:1790656687.950987:0:15712:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1790656687.951012:0:15712:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790656687.951016:0:15712:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790656687.951022:0:15712:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790656687.951044:0:15712:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1790656687.951048:0:15712:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:1.0:1790656687.966775:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790656687.970684:0:15712:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790656687.970724:0:15712:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790656687.970728:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790656687.970748:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790656687.970749:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656687.970751:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656687.970752:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656687.970753:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656687.970755:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656687.970756:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656687.970757:0:15712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790656687.970761:0:15712:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790656687.970763:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790656687.970765:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790656687.970766:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656687.970767:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656687.970768:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656687.970769:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656687.970769:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656687.970770:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656687.970771:0:15712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790656687.970800:0:15712:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790656687.970820:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269804928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790656687.970899:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656687.970965:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439287403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656687.971161:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269804928 00000100:00100000:0.0:1790656687.971170:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269804928 00000100:00100000:0.0:1790656687.971223:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790656687.971232:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:15712:x1877639269804928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790656687.971262:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790656687.971265:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790656687.971268:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790656687.999335:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:15712:x1877639269804928:12345-0@lo:253:mount.lustre.0 Request processed in 28095us (28427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656687.999351:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790656687.999699:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269804928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790656687.999715:0:15712:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790656687.999719:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790656687.999720:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790656687.999722:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790656687.999723:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790656687.999724:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790656687.999726:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790656687.999727:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790656687.999729:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790656687.999730:0:15712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790656687.999765:0:15712:0:(tgt_mount.c:101:server_register_mount()) register mount ffff943802a64800 from lustre-OST0001 10000000:01000000:3.0:1790656687.999792:0:15712:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790656687.999795:0:15712:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790656687.999802:0:15712:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff943802ee19c0 local copy 00010000:00010000:3.0:1790656687.999827:0:15712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656688.000062:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790656688.000103:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656688.000146:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928740480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656688.000489:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805056 00000100:00100000:0.0:1790656688.000496:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805056 00000100:00100000:0.0:1790656688.000542:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790656688.000551:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:15712:x1877639269805056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656688.005052:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:15712:x1877639269805056:12345-0@lo:501:mount.lustre.0 Request processed in 4254us (4701us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790656688.005065:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790656688.005438:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805056:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790656688.005462:0:15712:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790656688.005695:0:15712:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790656688.005706:0:15712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656688.005719:0:15712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928481c00/0x9c3a6e82066ebb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebb12 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656688.005756:0:15712:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff943802a64800 10000000:01000000:3.0:1790656688.005761:0:15712:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790656688.005767:0:15712:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790656688.005770:0:15712:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790656688.005775:0:15712:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790656688.005779:0:15712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790656688.005814:0:15712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656688.005823:0:15712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656688.005834:0:15712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656688.005867:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790656688.005912:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656688.005956:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928740480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.006631:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805184 00000100:00100000:1.0:1790656688.006640:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805184 00000100:00100000:1.0:1790656688.006696:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790656688.006707:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:15712:x1877639269805184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656688.006721:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656688.006743:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f07200/0x9c3a6e82066ebd6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebd65 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.006766:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f07200/0x9c3a6e82066ebd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd65 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.006777:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f07200/0x9c3a6e82066ebd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd65 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.006784:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f07200, rc 0) 00000100:00100000:1.0:1790656688.006845:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805184:12345-0@lo:101:mount.lustre.0 Request processed in 140us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.006852:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790656688.006959:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656688.006976:0:15712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd6c expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.006985:0:15712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebd6c expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790656688.008200:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790656688.009127:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790656688.009936:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790656688.009986:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790656688.010015:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790656688.010059:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790656688.010190:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790656688.010221:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790656688.010278:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790656688.010285:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790656688.010534:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656688.010620:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656688.010740:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439052e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.010807:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805312 00000100:00100000:2.0:1790656688.010815:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805312 00000100:00100000:2.0:1790656688.010908:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790656688.010919:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656688.011395:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805312:12345-0@lo:501:mount.lustre.0 Request processed in 477us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.011403:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790656688.011478:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790656688.011514:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790656688.011554:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656688.012236:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439052e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.014616:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805440 00000100:00100000:1.0:1790656688.014638:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805440 00000100:00100000:1.0:1790656688.014699:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790656688.014710:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656688.015455:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805440:12345-0@lo:503:mount.lustre.0 Request processed in 745us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.015464:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790656688.015771:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790656688.016828:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790656688.016912:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656688.016977:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656688.017015:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439052e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.017104:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805568 00000100:00100000:1.0:1790656688.017111:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805568 00000100:00100000:1.0:1790656688.017155:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790656688.017165:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656688.017751:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805568:12345-0@lo:502:mount.lustre.0 Request processed in 586us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.017759:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790656688.017875:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790656688.018116:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790656688.018170:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790656688.018209:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790656688.018260:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790656688.018523:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790656688.018578:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790656688.018678:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790656688.018719:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790656688.018769:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1790656688.018805:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790656688.018860:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656688.018894:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439052e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.018980:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805696 00000100:00100000:2.0:1790656688.018986:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805696 00000100:00100000:2.0:1790656688.019020:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790656688.019028:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790656688.019196:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805696:12345-0@lo:502:mount.lustre.0 Request processed in 168us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.019203:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790656688.019488:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790656688.019553:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1790656688.019564:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1790656688.020866:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790656688.020876:0:15714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790656688.020882:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.020885:0:15714:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790656688.020889:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790656688.020904:0:15714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94392810b380) 00000020:00000080:0.0:1790656688.020926:0:15714:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790656688.020932:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790656688.020990:0:15714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943802a64800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790656688.020997:0:15714:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790656688.021002:0:15714:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c3a6e82066ebd7a 00010000:00010000:0.0:1790656688.036719:0:15714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1790656688.037118:0:15714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1790656688.047035:0:15714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790656688.063135:0:15714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790656688.063146:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656688.063153:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656688.063155:0:15714:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790656688.063159:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656688.063163:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656688.063164:0:15714:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790656688.063167:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790656688.063169:0:15714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790656688.063171:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656688.063173:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656688.063175:0:15714:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790656688.063177:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790656688.063179:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656688.063180:0:15714:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790656688.063183:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790656688.063243:0:15714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790656688.063246:0:15714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790656688.063248:0:15714:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790656688.063251:0:15714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1790656688.075058:0:15712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790656688.075128:0:15712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790656688.075152:0:15712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd6c expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.075165:0:15712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c96a00/0x9c3a6e82066ebd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd6c expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656688.075174:0:15712:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943802a64800 from 1 10000000:01000000:1.0:1790656688.075176:0:15712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790656688.075214:0:15712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.075221:0:15712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.075231:0:15712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656688.075254:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790656688.075328:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.075366:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.075497:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805824 00000100:00100000:2.0:1790656688.075505:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805824 00000100:00100000:2.0:1790656688.075558:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790656688.075568:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:15712:x1877639269805824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790656688.075583:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656688.075611:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebd81 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.075658:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.075667:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.075676:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481200, rc 0) 00000100:00100000:2.0:1790656688.075730:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269805824:12345-0@lo:101:mount.lustre.0 Request processed in 163us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.075737:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790656688.075787:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790656688.075802:0:15712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656688.075810:0:15712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790656688.076335:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790656688.076766:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790656688.077022:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790656688.077069:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790656688.077133:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790656688.077141:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790656688.077203:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790656688.077253:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656688.077296:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928740cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.077327:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269805952 00000100:00100000:2.0:1790656688.077333:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269805952 00000100:00100000:2.0:1790656688.077376:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790656688.077384:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269805952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790656688.077585:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269805952:12345-0@lo:501:mount.lustre.0 Request processed in 200us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.077607:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790656688.077759:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269805952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656688.077792:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656688.077827:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.077854:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.078288:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806080 00000100:00100000:2.0:1790656688.078295:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806080 00000100:00100000:2.0:1790656688.078338:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790656688.078345:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790656688.078566:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806080:12345-0@lo:503:mount.lustre.0 Request processed in 221us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.078574:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790656688.078732:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790656688.079271:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790656688.079351:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656688.079400:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.079433:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.079620:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806208 00000100:00100000:2.0:1790656688.079634:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806208 00000100:00100000:2.0:1790656688.079666:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790656688.079672:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790656688.079832:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806208:12345-0@lo:502:mount.lustre.0 Request processed in 159us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.079840:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790656688.079926:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790656688.080154:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790656688.080199:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790656688.080249:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790656688.080287:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790656688.081206:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790656688.081264:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790656688.081299:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790656688.081345:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790656688.081382:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656688.081443:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.081479:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.081640:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806336 00000100:00100000:2.0:1790656688.081647:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806336 00000100:00100000:2.0:1790656688.081689:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790656688.081698:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790656688.081862:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806336:12345-0@lo:502:mount.lustre.0 Request processed in 165us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656688.081870:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790656688.084251:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790656688.084449:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790656688.084465:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790656688.089143:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656688.089156:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089158:0:15718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790656688.089164:0:15718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943802a64800 00000020:00000080:0.0:1790656688.089167:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790656688.089173:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656688.089175:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089184:0:15718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790656688.089188:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656688.089190:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089191:0:15718:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790656688.089195:0:15718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943802a64800 00000020:00000080:0.0:1790656688.089197:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790656688.089245:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656688.089248:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089249:0:15718:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790656688.089252:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790656688.089254:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089255:0:15718:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790656688.089258:0:15718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff943802a64800 00000020:00000080:0.0:1790656688.089260:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790656688.089294:0:15718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790656688.089298:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790656688.089300:0:15718:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790656688.089303:0:15718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1790656688.089548:0:15712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1790656688.089573:0:15712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790656688.089614:0:15712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.089635:0:15712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656688.089675:0:15712:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790656688.089678:0:15712:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff943802a64800 10000000:01000000:1.0:1790656688.089681:0:15712:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff943802a64800 10000000:01000000:1.0:1790656688.089690:0:15712:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790656688.089696:0:15712:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943802a64800 from 1 10000000:01000000:1.0:1790656688.089698:0:15712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790656688.089736:0:15712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.089745:0:15712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.089756:0:15712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656688.089778:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790656688.089845:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.089889:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656688.089960:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806464 00000100:00100000:0.0:1790656688.089967:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806464 00000100:00100000:0.0:1790656688.090013:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790656688.090023:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269806464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790656688.090035:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656688.090047:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94393b506400/0x9c3a6e82066ebd96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebd8f expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.090068:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94393b506400/0x9c3a6e82066ebd96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd8f expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.090298:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94393b506400/0x9c3a6e82066ebd96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd8f expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.090326:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94393b506400, rc 0) 00000100:00100000:0.0:1790656688.090369:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806464:12345-0@lo:101:mount.lustre.0 Request processed in 347us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.090376:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790656688.090566:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790656688.090582:0:15712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd96 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.090610:0:15712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebd96 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790656688.092527:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1790656688.092895:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790656688.100663:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790656688.100766:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790656688.100804:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790656688.100854:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790656688.100894:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790656688.100946:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790656688.101003:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790656688.101036:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790656688.103665:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790656688.103764:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790656688.103801:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790656688.103850:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790656688.103883:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790656688.103911:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790656688.103973:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790656688.104013:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790656688.104049:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790656688.107541:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790656688.110803:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790656688.110861:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790656688.110936:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790656688.110972:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790656688.111007:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790656688.111052:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790656688.111223:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1790656688.111258:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1790656688.111301:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1790656688.111417:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1790656688.111453:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1790656688.111518:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1790656688.111557:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1790656688.111619:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1790656688.111669:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1790656688.111720:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1790656688.111756:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1790656688.111803:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1790656688.111840:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1790656688.111935:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1790656688.111943:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1790656688.112063:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656688.116232:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.116278:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806592 00000100:00100000:1.0:1790656688.116286:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806592 00000100:00100000:1.0:1790656688.118818:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790656688.118839:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656688.119155:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806592:12345-0@lo:501:mount.lustre.0 Request processed in 324us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.119164:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790656688.119222:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.119247:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790656688.119302:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656688.119345:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.119371:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806720 00000100:00100000:1.0:1790656688.119380:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806720 00000100:00100000:1.0:1790656688.119404:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790656688.119411:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790656688.119668:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806720:12345-0@lo:503:mount.lustre.0 Request processed in 256us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.119676:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790656688.119710:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.119723:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790656688.120215:0:15712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790656688.120294:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656688.120334:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.120371:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806848 00000100:00100000:1.0:1790656688.120376:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806848 00000100:00100000:1.0:1790656688.120403:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790656688.120410:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790656688.126509:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656688.127678:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806848:12345-0@lo:502:mount.lustre.0 Request processed in 7263us (7338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.127691:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790656688.127748:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790656688.128054:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790656688.128526:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790656688.128564:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790656688.128655:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790656688.128696:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790656688.128797:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790656688.128846:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790656688.128882:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790656688.128929:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790656688.128964:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790656688.128994:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790656688.129055:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790656688.129209:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790656688.129243:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790656688.129304:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790656688.129473:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790656688.129506:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790656688.129555:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790656688.129613:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790656688.129663:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790656688.129713:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790656688.129917:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790656688.129957:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790656688.130006:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790656688.130044:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790656688.130638:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790656688.130851:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790656688.130910:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790656688.130948:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790656688.130997:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790656688.131034:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790656688.131069:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790656688.131278:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790656688.131410:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790656688.131454:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790656688.131531:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790656688.131573:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790656688.131650:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790656688.131700:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790656688.131935:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790656688.131986:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790656688.132063:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656688.132183:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393b9df480 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.133776:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269806976 00000100:00100000:2.0:1790656688.133787:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269806976 00000100:00100000:2.0:1790656688.133844:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790656688.133853:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790656688.134276:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269806976:12345-0@lo:502:mount.lustre.0 Request processed in 422us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.134285:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790656688.134419:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269806976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790656688.134528:0:15712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790656688.134542:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790656688.136222:0:15723:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790656688.136237:0:15723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff943802ee4d40) 00000020:00000080:3.0:1790656688.136260:0:15723:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1790656688.136409:0:15723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943802a64800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790656688.136413:0:15723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943802a64800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790656688.136416:0:15723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943802a64800 3 00010000:00080000:3.0:1790656688.136448:0:15723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9439072dc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1790656688.140769:0:15723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1790656688.140940:0:15723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790656688.140977:0:15723:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790656688.140988:0:15723:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c3a6e82066ebda4 00000100:00080000:3.0:1790656688.140997:0:15723:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790656688.141008:0:15723:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9439072dc000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1790656688.141040:0:15723:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bd3f800 x1877639269807104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790656688.141061:0:15723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790656688.144549:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269807104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790656688.144677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.144819:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807104 00000100:00100000:1.0:1790656688.144829:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807104 00000100:00100000:1.0:1790656688.144873:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790656688.144881:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1877639269807104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790656688.144911:0:14314:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:1.0:1790656688.144962:0:14314:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c3a6e82066ebdab 00000004:00100000:1.0:1790656688.144979:0:14314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790656688.145013:0:14314:0:(import.c:65:import_set_state_nolock()) ffff94393bfac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656688.145071:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1877639269807104:12345-0@lo:38:llog_process_th.0 Request processed in 189us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.145079:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790656688.145124:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bd3f800 x1877639269807104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790656698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656688.145135:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790656688.145143:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790656688.145151:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790656688.145156:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790656688.145164:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9439072dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790656688.145170:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1877639269807104:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790656688.147428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790656688.147434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790656688.147437:0:38:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790656688.147444:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1790656688.147449:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790656688.147459:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94390916a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656688.147477:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bea6a00 x1877639269807360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790656688.147521:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656688.147534:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269807232:0@lo:400:kworker.0 00000100:00100000:1.0:1790656688.147604:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.147653:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269807616:0@lo:400:kworker.0 00000100:00100000:1.0:1790656688.147679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.147695:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790656688.147700:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269807488:0@lo:400:kworker.0 00000100:00100000:1.0:1790656688.147718:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.147754:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807232 00000100:00100000:1.0:1790656688.147760:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807232 00000100:00100000:1.0:1790656688.147808:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1790656688.148975:0:15723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1790656688.149667:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269807232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656688.149755:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1877639269807232:12345-0@lo:400:kworker.0 Request processed in 1940us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.149989:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807616 00000100:00100000:0.0:1790656688.149997:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807616 00000100:00100000:0.0:1790656688.150109:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807488 00000100:00100000:0.0:1790656688.150114:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807488 00000100:00100000:0.0:1790656688.150133:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656688.150141:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269807616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656688.150190:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269807616:12345-0@lo:400:kworker.0 Request processed in 49us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.150196:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790656688.150211:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790656688.150217:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269807488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656688.150240:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877639269807488:12345-0@lo:400:kworker.0 Request processed in 24us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.150245:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790656688.150716:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790656688.150721:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656688.150743:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269807360:0@lo:8:kworker.0 00000100:00100000:0.0:1790656688.150779:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656688.152639:0:14999:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790656688.152652:0:14999:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790656688.155758:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269807232:0@lo:400:kworker.0 00000020:01000000:0.0:1790656688.155822:0:15712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790656688.155855:0:15712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790656688.155872:0:15712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd96 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.155884:0:15712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943801f06c00/0x9c3a6e82066ebd8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebd96 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790656688.155938:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790656688.155940:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656688.155942:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656688.155943:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656688.155944:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656688.155946:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656688.155947:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656688.155949:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656688.155950:0:15712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656688.155954:0:15712:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790656688.155956:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790656688.155957:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790656688.155958:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790656688.155960:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790656688.155960:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790656688.155961:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790656688.155963:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790656688.155964:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790656688.155965:0:15712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790656688.156004:0:15712:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790656688.156024:0:15712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269807744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790656688.156110:0:15712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656688.156152:0:15712:0:(client.c:2716:ptlrpc_set_wait()) set ffff943928234480 going to sleep for 11 seconds 00000100:00100000:2.0:1790656688.156394:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807360 00000100:00100000:2.0:1790656688.156403:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807360 00000100:00100000:2.0:1790656688.156440:0:14999:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790656688.156451:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656688.156458:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1877639269807360:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790656688.156525:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1877639269807360:12345-0@lo:8:kworker.0 Request processed in 66us (5744us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790656688.156533:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656688.156566:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790656688.156572:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790656688.156582:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790656688.156585:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269807360:0@lo:8:kworker.0 00010000:00080000:0.0:1790656688.158091:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bea6300 x1877639269807488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656688.158107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877639269807488:0@lo:400:kworker.0 00010000:00080000:0.0:1790656688.158131:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94393bea7100 x1877639269807616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790656688.158140:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269807616:0@lo:400:kworker.0 00000100:00100000:1.0:1790656688.160702:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790656688.160765:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807744 00000100:00100000:1.0:1790656688.160774:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807744 00000100:00100000:1.0:1790656688.160816:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790656688.160826:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:15712:x1877639269807744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790656688.160854:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790656688.160866:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790656688.211353:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790656688.211372:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790656688.211430:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790656688.211436:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790656688.211459:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.211476:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.211485:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.211523:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656688.211539:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 19 pid: 14305 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656688.211553:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269807872:0@lo:104: 00000100:00100000:2.0:1790656688.211650:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656688.211708:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439283c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656688.212449:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269807872 00000100:00100000:0.0:1790656688.212458:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269807872 00000100:00100000:0.0:1790656688.213296:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656688.213310:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269807872:12345-0@lo:104: 00010000:00010000:0.0:1790656688.213331:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656688.213414:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656688.213421:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:14329:x1877639269807872:12345-0@lo:104: Request processed in 116us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.213428:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656688.213544:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1877639269807872:0@lo:104: 00010000:00010000:2.0:1790656688.213569:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214091:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656688.214099:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214107:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:1.0:1790656688.214111:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214120:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790656688.214128:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790656688.214133:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790656688.214212:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214219:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790656688.214248:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214257:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928481600/0x9c3a6e82066ebc85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc8c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214292:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656688.214294:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656688.214295:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656688.214303:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656688.214318:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269808000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656688.214374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656688.214417:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808000 00000100:00100000:1.0:1790656688.214422:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808000 00010000:00010000:1.0:1790656688.214446:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 20 pid: 14305 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656688.214471:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790656688.214478:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+20:3302:x1877639269808000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656688.214490:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656688.214495:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 20 pid: 14305 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214507:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 20 pid: 14305 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214520:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94393b507000/0x9c3a6e82066ebc8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebc85 expref: 20 pid: 14305 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214534:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214543:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790656688.214567:0:14300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003131582s 00010000:00010000:1.0:1790656688.214571:0:14300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214578:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214585:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214619:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214637:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656688.214641:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214648:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214660:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.214669:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790656688.214701:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3302:x1877639269808000:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656688.214708:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790656688.214742:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269808000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790656688.215067:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.215082:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656688.215088:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928480c00/0x9c3a6e82066ebdb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656688.220120:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:15712:x1877639269807744:12345-0@lo:253:mount.lustre.0 Request processed in 59286us (63999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656688.220134:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790656688.220252:0:15712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:15712:1877639269807744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790656688.220273:0:15712:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790656688.220276:0:15712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790656688.220278:0:15712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790656688.220279:0:15712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790656688.220281:0:15712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790656688.220282:0:15712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790656688.220284:0:15712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790656688.220285:0:15712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790656688.220287:0:15712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790656688.220289:0:15712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790656688.220302:0:15712:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790656688.225035:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656688.225201:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790656688.225351:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656688.225502:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790656688.225687:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790656688.225892:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790656688.227034:0:15712:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790656688.305619:0:15712:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790656688.305637:0:15712:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790656688.305671:0:15712:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790656688.305734:0:15712:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790656688.305747:0:15712:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790656688.305786:0:15712:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1790656688.992166:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790656689.951634:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790656689.951641:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff943907838800 from 8 10000000:01000000:2.0:1790656689.951646:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790656689.951694:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656689.951716:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656689.951728:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656689.951753:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269808128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790656689.951829:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656689.951879:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94480 going to sleep for 11 seconds 00000100:00100000:1.0:1790656689.952451:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808128 00000100:00100000:1.0:1790656689.952460:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808128 00000100:00100000:1.0:1790656689.952506:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790656689.952515:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269808128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656689.952528:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656689.952542:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f06000/0x9c3a6e82066ebdc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebdb9 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656689.952569:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f06000/0x9c3a6e82066ebdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebdb9 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656689.952579:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f06000/0x9c3a6e82066ebdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebdb9 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656689.952587:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06000, rc 0) 00000100:00100000:1.0:1790656689.954504:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269808128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1986us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656689.954515:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790656689.958278:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269808128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656689.958304:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebdc0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656689.958316:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebdc0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656689.958397:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269808256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790656689.958456:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656689.958499:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94480 going to sleep for 11 seconds 00000100:00100000:0.0:1790656689.958690:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808256 00000100:00100000:0.0:1790656689.958697:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808256 00000100:00100000:0.0:1790656689.958749:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790656689.958759:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269808256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790656689.958778:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790656689.958795:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790656689.958798:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790656689.958890:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269808256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656689.958901:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790656689.958942:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269808256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790656689.959008:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790656689.959016:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebdc0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656689.959025:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943928480800/0x9c3a6e82066ebdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebdc0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656690.015441:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790656690.449735:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790656690.449756:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1790656691.040937:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656691.361500:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269808384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790656691.361574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656691.361752:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808384 00000100:00100000:2.0:1790656691.361761:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808384 00000100:00100000:2.0:1790656691.361825:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656691.361835:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269808384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656691.361868:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656691.361915:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269808384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656691.361939:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656691.361979:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790656691.362001:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269808384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656691.362064:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790656692.062856:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.086710:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790656693.345477:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1790656693.408854:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790656693.408861:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790656693.408864:0:38:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790656693.408892:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94390916a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1790656693.408917:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94393bea7100 x1877639269808768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790656693.408985:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269808768:0@lo:8:kworker.0 00000100:00100000:1.0:1790656693.409057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656693.409130:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269809024:0@lo:400:kworker.0 00000100:00100000:1.0:1790656693.409155:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656693.409173:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790656693.409179:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269808896:0@lo:400:kworker.0 00000100:00100000:1.0:1790656693.409198:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656693.409227:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808768 00000100:00100000:1.0:1790656693.409234:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808768 00000100:00100000:1.0:1790656693.409271:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790656693.409279:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1877639269808768:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790656693.409303:0:14999:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:1.0:1790656693.409330:0:14999:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c3a6e82066ebdc7 00002000:00100000:1.0:1790656693.409343:0:14999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff943803546800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790656693.409347:0:14999:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1790656693.409350:0:14999:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790656693.409699:0:14999:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790656693.409723:0:14999:0:(import.c:65:import_set_state_nolock()) ffff943803540800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656693.409771:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1877639269808768:12345-0@lo:8:kworker.0 Request processed in 491us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656693.409778:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790656693.409815:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bea7100 x1877639269808768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790656718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790656693.409842:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790656693.409849:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790656693.409854:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790656693.409856:0:3298:0:(import.c:65:import_set_state_nolock()) ffff94390916a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790656693.409868:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790656693.409873:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1877639269808768:0@lo:8:kworker.0 00000004:00080000:1.0:1790656693.409910:0:14338:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1790656693.409924:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1877639269809408:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790656693.409947:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656693.409962:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bce540 going to sleep for 11 seconds 00000004:00080000:1.0:1790656693.409975:0:14337:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790656693.410246:0:14337:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408546653679ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790656693.411537:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269808512:0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.411623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656693.411657:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269809152:0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.411681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656693.411713:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790656693.411721:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269808640:0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.411744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656693.411763:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269809280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656693.411786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656693.411821:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809024 00000100:00100000:0.0:1790656693.411827:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809024 00000100:00100000:0.0:1790656693.411866:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808896 00000100:00100000:0.0:1790656693.411869:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808896 00000100:00100000:0.0:1790656693.411883:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809152 00000100:00100000:0.0:1790656693.411893:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809152 00000100:00100000:0.0:1790656693.411912:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790656693.411919:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269809024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.411969:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269809024:12345-0@lo:400:kworker.0 Request processed in 50us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656693.411976:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790656693.411991:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790656693.411997:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269808896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.412025:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269808896:12345-0@lo:400:kworker.0 Request processed in 28us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656693.412030:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790656693.412042:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656693.412049:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269809152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656693.412082:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269809152:12345-0@lo:400:kworker.0 Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656693.412089:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656693.412113:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809408 00000100:00100000:0.0:1790656693.412116:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809408 00000100:00100000:2.0:1790656693.412125:0:15726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808640 00000100:00100000:2.0:1790656693.412133:0:15726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808640 00000100:00100000:0.0:1790656693.412145:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656693.412153:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14338:x1877639269809408:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790656693.412270:0:15726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790656693.412279:0:15726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269808640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656693.412326:0:15726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269808640:12345-0@lo:400:kworker.0 Request processed in 48us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656693.412333:0:15726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1790656693.414571:0:14996:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790656693.414581:0:14996:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1790656693.417995:0:14996:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1790656693.419120:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269808512 00000100:00100000:1.0:1790656693.419132:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269808512 00000100:00100000:1.0:1790656693.419182:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790656693.419191:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3299:x1877639269808512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656693.419280:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3299:x1877639269808512:12345-0@lo:400:kworker.0 Request processed in 90us (7656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656693.419288:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790656693.420971:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809280 00000100:00100000:1.0:1790656693.420980:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809280 00000100:00100000:1.0:1790656693.421020:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790656693.421027:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1877639269809280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790656693.421057:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790656693.421116:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1877639269809280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (9328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656693.421134:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790656693.421175:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656693.421179:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656693.421182:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790656693.421213:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bea6300 x1877639269808896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656693.421228:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269808896:0@lo:400:kworker.0 00010000:00080000:1.0:1790656693.421241:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bea6a00 x1877639269809024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656693.421249:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269809024:0@lo:400:kworker.0 00000100:00100000:1.0:1790656693.421292:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269808640:0@lo:400:kworker.0 00010000:00080000:1.0:1790656693.421303:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9439280c0a80 x1877639269809280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790656709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656693.421317:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269809280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790656693.421327:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269808512:0@lo:400:kworker.0 00010000:00080000:1.0:1790656693.421337:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94393bea7b80 x1877639269809152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790656709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790656693.421343:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269809152:0@lo:400:kworker.0 00002000:00010000:0.0:1790656693.440347:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.440358:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.440386:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.440391:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.440397:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.440414:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.440424:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.440433:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.440450:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656693.442147:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.442158:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.442172:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.442183:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.442196:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.442219:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.442228:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde409d0/0x9c3a6e82066ebdce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.442251:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.442254:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.442256:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.444420:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.444431:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444446:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.444451:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.444457:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444472:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444494:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444514:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444534:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.444546:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.444550:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444558:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.444563:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444572:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444612:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444620:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be54f47/0x9c3a6e82066ebdd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.444645:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.444652:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.444654:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.446400:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.446410:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.446423:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.446427:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.446433:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.446444:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.446453:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.446460:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.446478:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656693.447183:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.447191:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.447201:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.447205:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.447215:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.447232:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.447247:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a84410/0x9c3a6e82066ebddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.447265:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.447267:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.447268:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.450329:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.450342:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450358:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.450362:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.450368:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450387:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450398:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450406:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450423:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.450435:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.450440:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450447:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.450451:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450459:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450473:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450480:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b9d2d80/0x9c3a6e82066ebde3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.450504:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.450506:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.450507:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.453992:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.454005:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454021:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.454026:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.454033:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454047:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454057:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454066:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454084:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.454505:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.454512:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454532:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.454535:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.454539:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454547:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454555:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454562:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454577:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790656693.454618:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656693.454625:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454633:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.454637:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454646:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454675:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454683:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000646cfe9c/0x9c3a6e82066ebdea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454701:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.454707:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454714:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.454718:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454725:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454735:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454741:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f1cc5f/0x9c3a6e82066ebdf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.454963:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.454966:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.454974:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.455201:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790656693.458095:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1790656693.458559:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.458568:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459147:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.459154:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.459161:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459178:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459188:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459196:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459216:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.459228:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.459233:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459241:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.459245:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459262:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459278:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459286:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063420f71/0x9c3a6e82066ebdf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.459304:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.459305:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.459307:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.460005:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.460013:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460023:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.460026:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.460030:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460040:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460048:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460063:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460083:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.460446:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.460451:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460459:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.460462:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.460465:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460474:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460481:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460487:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460501:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790656693.460510:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656693.460514:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460525:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.460528:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460535:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460547:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460554:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d83f78c/0x9c3a6e82066ebdff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460567:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.460571:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.460576:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506e00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.460578:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.460871:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.461017:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461029:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461041:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c355e08/0x9c3a6e82066ebe06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461054:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.461056:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.461058:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.461468:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.461474:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461484:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.461487:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.461491:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461500:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461509:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461515:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.461574:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.462068:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.462080:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.462089:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.462092:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.462096:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.462106:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.462114:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.462120:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.462574:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790656693.464366:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464379:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656693.464383:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464393:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464413:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464419:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084eee2eb/0x9c3a6e82066ebe0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464439:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656693.464443:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464449:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b507600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656693.464451:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464458:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464477:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.464484:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.464485:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.464487:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.464581:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790656693.464939:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.464994:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea831d39/0x9c3a6e82066ebe14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790656693.466294:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.466305:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466320:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.466325:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.466340:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466353:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466363:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466370:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466387:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.466931:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.466937:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466947:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.466950:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.466955:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466965:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466973:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.466991:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467005:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790656693.467015:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656693.467020:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467027:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94393b506600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.467031:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467040:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467054:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467062:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd9b93ad/0x9c3a6e82066ebe1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467077:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.467081:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467098:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.467101:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467109:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467119:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467126:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009eccc36/0x9c3a6e82066ebe22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467138:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.467139:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.467141:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.467469:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.467475:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467483:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.467487:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.467491:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467499:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467512:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467519:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467531:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.467537:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.467541:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467547:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.467550:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467558:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467568:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467574:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207cb55f/0x9c3a6e82066ebe29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467613:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.467620:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.467621:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.467967:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.467972:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467981:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.467984:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.467988:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.467996:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468004:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468011:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468023:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.468029:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.468032:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468039:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.468042:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468059:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468069:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468076:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d57c2c/0x9c3a6e82066ebe30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468089:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.468090:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.468092:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.468465:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.468471:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468479:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.468482:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.468486:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468494:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468502:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468515:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468527:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.468536:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.468539:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468546:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.468549:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468556:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468567:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.468574:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008424d78/0x9c3a6e82066ebe37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.472372:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.473567:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.473572:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.473574:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.475402:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.475423:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.475440:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.475444:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.475450:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.475463:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.475472:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.475480:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.475497:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.476452:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.476460:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.476471:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.476474:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.476478:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.476488:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.476503:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.476509:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.476529:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790656693.476871:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790656693.476878:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476886:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.476890:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476898:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476914:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476921:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023cb8686/0x9c3a6e82066ebe3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476947:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.476951:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476957:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.476961:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476968:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476978:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476985:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efdbd0b6/0x9c3a6e82066ebe45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.476998:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.477000:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.477002:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790656693.477220:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1790656693.477564:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.477570:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.477580:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.477617:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.477622:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.477632:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.477641:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.477648:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.477675:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656693.477865:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.477871:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.477878:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.477888:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.477895:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.477907:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.477914:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6280be3/0x9c3a6e82066ebe4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.477929:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.477931:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.477932:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.478424:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.478430:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.478439:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.478443:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.478447:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.478456:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.478464:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.478471:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.478492:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656693.478972:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.478978:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.478986:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.478990:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.478999:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.479013:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.479026:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a50e6a/0x9c3a6e82066ebe53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.479047:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.479049:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.479050:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.479375:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.479382:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.479390:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.479399:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.479403:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.479412:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.479419:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.479426:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.479476:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790656693.480203:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.480209:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.480219:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.480222:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.480226:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.480237:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.480245:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.480259:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.483919:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790656693.483934:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.483949:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.483953:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.483964:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.483984:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.483992:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b00674/0x9c3a6e82066ebe5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.484022:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.484026:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.484048:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.484051:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.484058:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.484069:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.484079:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.484080:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.484082:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790656693.488260:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.491946:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790656693.491960:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1b9a8ab/0x9c3a6e82066ebe61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.494056:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.501327:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.501343:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501361:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.501366:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.501385:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501400:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501410:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501418:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501452:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.501465:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.501471:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501479:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802355400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.501483:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501493:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501509:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501516:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aec1bb8b/0x9c3a6e82066ebe68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.501536:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.501538:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.501539:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.504348:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.504358:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.504373:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.504383:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.504389:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.504401:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.504411:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.504418:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.504435:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790656693.505898:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790656693.505909:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.505921:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802355800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:1.0:1790656693.505926:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.505936:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.505955:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.505975:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c093a22e/0x9c3a6e82066ebe6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656693.505999:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.506001:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790656693.506003:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.508297:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.508310:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508325:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.508329:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.508336:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508350:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508359:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508374:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508391:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790656693.508405:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656693.508410:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508418:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656693.508422:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508430:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508446:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508452:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba2f29be/0x9c3a6e82066ebe76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.508471:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.508472:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656693.508474:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.513862:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.513987:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.514003:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.514008:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.514014:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.514027:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.514037:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.514045:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.514069:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656693.515736:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656693.515747:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.515760:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656693.515765:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.515776:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.515797:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.515805:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005907dd9e/0x9c3a6e82066ebe7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.515828:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.515830:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.515832:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.518083:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.518096:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.518113:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.518117:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.518124:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.518136:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.518153:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.518161:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.518180:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790656693.518739:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656693.518746:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.518754:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802355600 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656693.518759:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.518768:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.518785:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.518792:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000163924f6/0x9c3a6e82066ebe84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.518810:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.518811:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.518813:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790656693.521026:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790656693.521041:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.521057:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1790656693.521061:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656693.521067:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.521079:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.521087:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.521094:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656693.521122:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790656693.521356:0:14996:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1790656693.521461:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14338:x1877639269809408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109305us (111508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656693.521471:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656693.521531:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1877639269809408:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790656693.521547:0:14338:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1790656693.521639:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1877639269809536:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790656693.521673:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790656693.521869:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656693.521878:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.521887:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656693.521891:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.521912:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.521930:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.521938:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003377fc6f/0x9c3a6e82066ebe8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656693.521959:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.521961:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656693.521963:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656693.524052:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809536 00000100:00100000:3.0:1790656693.524066:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809536 00000100:00100000:3.0:1790656693.524125:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790656693.524135:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14338:x1877639269809536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790656693.524182:0:14996:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1790656693.526934:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439011cab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656693.537622:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14338:x1877639269809536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13450us (15909us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790656693.537635:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790656693.537943:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393b9eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1877639269809536:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790656693.537962:0:14338:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1790656694.112454:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790656694.881909:0:16072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790656695.138666:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656696.160381:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656696.481277:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269809664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656696.481353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656696.483718:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809664 00000100:00100000:2.0:1790656696.483730:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809664 00000100:00100000:2.0:1790656696.483806:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656696.483816:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269809664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656696.483855:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656696.484049:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269809664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656696.484057:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790656696.484109:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269809664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790656696.484238:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656697.087097:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.087921:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845568 00000100:00100000:2.0:1790656697.087946:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845568 00000100:00100000:2.0:1790656697.087995:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1790656697.088003:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2338:x1877639248845568:12345-192.168.203.23@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790656697.088030:0:14308:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from db2c7c86-2ba2-4fa5-bdc1-e1f09552f676@192.168.203.23@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:2.0:1790656697.088056:0:14308:0:(genops.c:1384:class_connect()) connect: client db2c7c86-2ba2-4fa5-bdc1-e1f09552f676, cookie 0x9c3a6e82066ebe92 00000100:00080000:2.0:1790656697.088193:0:14308:0:(import.c:65:import_set_state_nolock()) ffff943934ed9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656697.088264:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+5:2338:x1877639248845568:12345-192.168.203.23@tcp:250:mount.lustre.0 Request processed in 259us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.088271:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:0.0:1790656697.107550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656697.107756:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845696 00000100:00100000:1.0:1790656697.107768:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845696 00000100:00100000:1.0:1790656697.107823:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:1.0:1790656697.107833:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+5:13703:x1877639248845696:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790656697.107849:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656697.107874:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebe99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237ab8 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656697.107900:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ab8 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656697.107910:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943801f06800/0x9c3a6e82066ebe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ab8 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656697.107919:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06800, rc 0) 00000100:00100000:1.0:1790656697.107980:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+6:13703:x1877639248845696:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 148us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656697.107987:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:3.0:1790656697.116839:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656697.116911:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845824 00000100:00100000:1.0:1790656697.116921:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845824 00000100:00100000:1.0:1790656697.116976:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:1.0:1790656697.116985:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+6:13703:x1877639248845824:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790656697.117506:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+6:13703:x1877639248845824:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 519us (673us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656697.117514:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1790656697.121799:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.122104:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248845952 00000100:00100000:2.0:1790656697.122114:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248845952 00000100:00100000:2.0:1790656697.122168:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1790656697.122178:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+6:13703:x1877639248845952:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790656697.122194:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656697.122210:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943928480200/0x9c3a6e82066ebea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237abf expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656697.122236:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943928480200/0x9c3a6e82066ebea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237abf expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656697.122247:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943928480200/0x9c3a6e82066ebea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237abf expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656697.122256:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480200, rc 0) 00000100:00100000:2.0:1790656697.122313:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+7:13703:x1877639248845952:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 136us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.122320:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:0.0:1790656697.139424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656697.139542:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846080 00000100:00100000:1.0:1790656697.139551:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846080 00000100:00100000:1.0:1790656697.139637:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1790656697.139646:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+7:13703:x1877639248846080:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790656697.140226:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13703:x1877639248846080:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 573us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656697.140233:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1790656697.150488:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.150636:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846208 00000100:00100000:0.0:1790656697.150647:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846208 00000100:00100000:0.0:1790656697.150702:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:0.0:1790656697.150721:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13703:x1877639248846208:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790656697.150954:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13703:x1877639248846208:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 233us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.150969:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1790656697.154266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.155077:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846336 00000100:00100000:2.0:1790656697.155090:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846336 00000100:00100000:2.0:1790656697.155171:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:2.0:1790656697.155181:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393514e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13722:x1877639248846336:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656697.155455:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393514e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13722:x1877639248846336:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 274us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.155463:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:3.0:1790656697.183913:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656697.192112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656697.192173:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846464 00000100:00100000:1.0:1790656697.192183:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846464 00000100:00100000:1.0:1790656697.192247:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1790656697.192258:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13722:x1877639248846464:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790656697.192626:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13722:x1877639248846464:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 369us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656697.192635:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:3.0:1790656697.203674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.209496:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846592 00000100:00100000:0.0:1790656697.209510:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846592 00000100:00100000:0.0:1790656697.209583:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:0.0:1790656697.209606:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+8:13703:x1877639248846592:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656697.209620:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656697.209635:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802355c00/0x9c3a6e82066ebea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237ae9 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.209658:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802355c00/0x9c3a6e82066ebea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ae9 expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.209666:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802355c00/0x9c3a6e82066ebea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ae9 expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.209671:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802355c00, rc 0) 00000100:00100000:0.0:1790656697.210001:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+9:13703:x1877639248846592:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 407us (6332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.210008:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:3.0:1790656697.220438:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.220575:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846720 00000100:00100000:2.0:1790656697.220585:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846720 00000100:00100000:2.0:1790656697.220662:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:2.0:1790656697.220673:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+9:13703:x1877639248846720:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790656697.220708:0:14308:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790656697.220726:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790656697.220731:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790656697.220734:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790656697.220736:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790656697.226857:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+9:13703:x1877639248846720:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 6174us (6413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.226872:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:3.0:1790656697.241401:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.241572:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846848 00000100:00100000:0.0:1790656697.241582:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846848 00000100:00100000:0.0:1790656697.241670:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:0.0:1790656697.241681:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+9:13703:x1877639248846848:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656697.241706:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656697.241725:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237af0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.241794:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.241806:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.241814:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354400, rc 0) 00000100:00100000:0.0:1790656697.241878:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13703:x1877639248846848:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 199us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.241886:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:1.0:1790656697.246320:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.246537:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248846976 00000100:00100000:2.0:1790656697.246549:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248846976 00000100:00100000:2.0:1790656697.246643:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:2.0:1790656697.246654:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13703:x1877639248846976:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790656697.247081:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13703:x1877639248846976:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 427us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.247089:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1790656697.250495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656697.250626:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847104 00000100:00100000:1.0:1790656697.250636:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847104 00000100:00100000:1.0:1790656697.250691:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:1.0:1790656697.250713:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13703:x1877639248847104:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790656697.251070:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13703:x1877639248847104:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 359us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.251080:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1790656697.255443:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.255747:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847232 00000100:00100000:0.0:1790656697.255758:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847232 00000100:00100000:0.0:1790656697.255815:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:0.0:1790656697.255825:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13727:x1877639248847232:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790656697.256451:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13727:x1877639248847232:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 626us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.256461:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1790656697.261934:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.262026:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847360 00000100:00100000:0.0:1790656697.262036:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847360 00000100:00100000:0.0:1790656697.262100:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:0.0:1790656697.262110:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13727:x1877639248847360:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790656697.262898:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13727:x1877639248847360:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 785us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.262915:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1790656697.286119:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.286465:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847488 00000100:00100000:0.0:1790656697.286475:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847488 00000100:00100000:0.0:1790656697.286532:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1790656697.286541:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2338:x1877639248847488:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790656697.286580:0:14313:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e04176dd-0835-45f2-9651-67d83fe9deba@192.168.203.23@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:0.0:1790656697.286656:0:14313:0:(genops.c:1384:class_connect()) connect: client e04176dd-0835-45f2-9651-67d83fe9deba, cookie 0x9c3a6e82066ebeb5 00000004:00100000:0.0:1790656697.286685:0:14313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790656697.286691:0:14313:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790656697.336910:0:14313:0:(import.c:65:import_set_state_nolock()) ffff94380275a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656697.336982:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:2338:x1877639248847488:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 50439us (50872us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.336993:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1790656697.351534:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656697.351581:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.351652:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847616 00000100:00100000:2.0:1790656697.351663:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847616 00000100:00100000:2.0:1790656697.351730:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847744 00000100:00100000:2.0:1790656697.351734:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847744 00000100:00100000:2.0:1790656697.351751:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1790656697.351760:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+7:0:x1877639248847616:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790656697.351802:0:14315:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790656697.351898:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+7:0:x1877639248847616:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.351906:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1790656697.351925:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656697.351933:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248847744:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790656697.351945:0:14315:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790656697.351969:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248847744:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.351976:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00080000:3.0:1790656697.352049:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656697.370350:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.370698:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248847872 00000100:00100000:0.0:1790656697.370709:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248847872 00000100:00100000:0.0:1790656697.370777:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1790656697.370788:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248847872:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790656697.370975:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248847872:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 188us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.370983:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656697.376037:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.376175:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656697.376437:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656697.376585:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848256 00000100:00100000:3.0:1790656697.376619:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848256 00000100:00100000:3.0:1790656697.376671:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1790656697.376682:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248848256:12345-192.168.203.23@tcp:33:mount.lustre.0 00000100:00100000:1.0:1790656697.376993:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848000 00000100:00100000:1.0:1790656697.376998:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848000 00000100:00100000:1.0:1790656697.377028:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848128 00000100:00100000:1.0:1790656697.377031:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848128 00000100:00100000:1.0:1790656697.377055:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1790656697.377171:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1790656697.377176:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2338:x1877639248848128:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790656697.377201:0:14999:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e04176dd-0835-45f2-9651-67d83fe9deba@192.168.203.23@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:2.0:1790656697.377228:0:14999:0:(genops.c:1384:class_connect()) connect: client e04176dd-0835-45f2-9651-67d83fe9deba, cookie 0x9c3a6e82066ebebc 00002000:00100000:2.0:1790656697.377239:0:14999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e04176dd-0835-45f2-9651-67d83fe9deba/ffff943934ede800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790656697.377274:0:14999:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790656697.377460:0:14999:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790656697.377490:0:14999:0:(import.c:65:import_set_state_nolock()) ffff943934edf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790656697.377573:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:2338:x1877639248848128:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 394us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656697.377581:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1790656697.377889:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2338:x1877639248848000:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790656697.377908:0:14998:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e04176dd-0835-45f2-9651-67d83fe9deba@192.168.203.23@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1790656697.377928:0:14998:0:(genops.c:1384:class_connect()) connect: client e04176dd-0835-45f2-9651-67d83fe9deba, cookie 0x9c3a6e82066ebec3 00002000:00100000:1.0:1790656697.377935:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e04176dd-0835-45f2-9651-67d83fe9deba/ffff943803542800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790656697.377942:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790656697.378339:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790656697.378358:0:14998:0:(import.c:65:import_set_state_nolock()) ffff943803547000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790656697.378407:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+6:2338:x1877639248848000:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1344us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656697.378414:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000004:00080000:3.0:1790656697.379338:0:14316:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2596us 00000004:00200000:3.0:1790656697.397900:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790656697.398012:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:13703:x1877639248848256:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 21327us (21570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656697.398024:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1790656697.621871:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656697.621959:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848384 00000100:00100000:0.0:1790656697.621968:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848384 00000100:00100000:0.0:1790656697.622029:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1790656697.622040:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:13748:x1877639248848384:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:0.0:1790656697.622057:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656697.622094:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355a00/0x9c3a6e82066ebeca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b1a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622168:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622182:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622197:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656697.622229:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656697.622233:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656697.622269:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622293:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355a00/0x9c3a6e82066ebeca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b1a expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622310:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b1a expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656697.622318:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:0.0:1790656697.622321:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656697.622324:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802355000, rc 0) 00000100:00100000:0.0:1790656697.622386:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+7:13748:x1877639248848384:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 348us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656697.622393:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00010000:00010000:3.0:1790656698.209323:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656698.526872:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790656698.526895:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656698.526966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656698.527050:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809792 00000100:00100000:2.0:1790656698.527058:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809792 00000100:00100000:2.0:1790656698.527110:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790656698.527119:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269809792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656698.527141:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790656698.527514:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790656698.527623:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269810048:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.527657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656698.527682:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790656698.527688:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269809920:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.527727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656698.527752:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269810432:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.527784:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656698.527810:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269810304:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.527830:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656698.527859:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790656698.527865:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269810176:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.527889:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656698.527913:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810432 00000100:00100000:3.0:1790656698.527917:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810432 00000100:00100000:3.0:1790656698.527947:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810304 00000100:00100000:3.0:1790656698.527950:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810304 00000100:00100000:3.0:1790656698.527962:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810176 00000100:00100000:3.0:1790656698.527965:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810176 00000100:00100000:3.0:1790656698.527977:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790656698.527982:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269810432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528022:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269810432:12345-0@lo:400:kworker.0 Request processed in 39us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656698.528029:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790656698.528044:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656698.528050:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269810304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528080:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269810304:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656698.528086:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656698.528097:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656698.528102:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269810176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528127:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877639269810176:12345-0@lo:400:kworker.0 Request processed in 24us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656698.528131:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1790656698.528144:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656698.528249:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877639269810176:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528260:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269810304:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528488:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269810432:0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528509:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810048 00000100:00100000:3.0:1790656698.528513:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810048 00000100:00100000:3.0:1790656698.528542:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790656698.528559:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269810048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656698.528611:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269810048:12345-0@lo:400:kworker.0 Request processed in 64us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656698.528618:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790656698.528632:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656698.528646:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269810048:0@lo:400:kworker.0 00000100:00100000:1.0:1790656698.528842:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269809792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1722us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656698.528854:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656698.529392:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269809920 00000100:00100000:0.0:1790656698.529405:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269809920 00000100:00100000:0.0:1790656698.529437:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790656698.529445:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3300:x1877639269809920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656698.529491:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3300:x1877639269809920:12345-0@lo:400:kworker.0 Request processed in 46us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656698.529497:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790656698.538244:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790656698.538296:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3300:1877639269809920:0@lo:400:kworker.0 00000001:00100000:1.0:1790656698.590325:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e04176dd-0835-45f2-9651-67d83fe9deba 00000001:00080000:1.0:1790656698.590339:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1790656699.231658:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656699.986252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656699.986504:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848512 00000100:00100000:3.0:1790656699.986518:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848512 00000100:00100000:3.0:1790656699.986677:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1790656699.986691:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+7:13801:x1877639248848512:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:3.0:1790656699.986819:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790656699.987013:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+7:13801:x1877639248848512:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 324us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656699.987022:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:0.0:1790656699.987281:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656699.991561:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656699.991792:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848640 00000100:00100000:0.0:1790656699.991807:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848640 00000100:00100000:0.0:1790656699.991943:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1790656699.991958:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e04176dd-0835-45f2-9651-67d83fe9deba+6:13801:x1877639248848640:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:0.0:1790656699.992009:0:15001:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656699.992115:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e04176dd-0835-45f2-9651-67d83fe9deba+6:13801:x1877639248848640:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 162us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656699.992124:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00080000:3.0:1790656699.992525:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790656700.002113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656700.002365:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848768 00000100:00100000:2.0:1790656700.002378:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848768 00000100:00100000:2.0:1790656700.002467:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656700.002480:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e04176dd-0835-45f2-9651-67d83fe9deba+5:13801:x1877639248848768:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:2.0:1790656700.002534:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656700.002707:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e04176dd-0835-45f2-9651-67d83fe9deba+5:13801:x1877639248848768:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 228us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656700.002716:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00080000:3.0:1790656700.002804:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790656700.257186:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656700.272428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.272574:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248848896 00000100:00100000:0.0:1790656700.272625:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248848896 00000100:00100000:0.0:1790656700.272707:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:0.0:1790656700.272725:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+10:13833:x1877639248848896:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656700.272747:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656700.272773:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802355a00/0x9c3a6e82066ebed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b21 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.272809:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802355a00/0x9c3a6e82066ebed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b21 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.272821:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802355a00/0x9c3a6e82066ebed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b21 expref: 11 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.272842:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802355a00, rc 0) 00000100:00100000:0.0:1790656700.273638:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248848896:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 910us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.273648:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:1.0:1790656700.285223:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656700.286075:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849024 00000100:00100000:2.0:1790656700.286094:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849024 00000100:00100000:2.0:1790656700.286179:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:2.0:1790656700.286193:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248849024:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790656700.286845:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248849024:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 652us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656700.286856:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:1.0:1790656700.294169:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.294292:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849152 00000100:00100000:0.0:1790656700.294310:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849152 00000100:00100000:0.0:1790656700.294401:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:0.0:1790656700.294415:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248849152:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790656700.294987:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248849152:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 570us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.294997:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:3.0:1790656700.312264:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.313495:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849280 00000100:00100000:0.0:1790656700.313517:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849280 00000100:00100000:0.0:1790656700.313657:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1790656700.313672:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13839:x1877639248849280:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790656700.314561:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13839:x1877639248849280:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 887us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.314573:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:1.0:1790656700.352520:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656700.352771:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849408 00000100:00100000:2.0:1790656700.352785:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849408 00000100:00100000:2.0:1790656700.352857:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:2.0:1790656700.352869:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13839:x1877639248849408:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656700.353271:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13839:x1877639248849408:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 400us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656700.353286:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:1.0:1790656700.360838:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.363004:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849536 00000100:00100000:0.0:1790656700.363025:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849536 00000100:00100000:0.0:1790656700.363129:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:0.0:1790656700.363142:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13833:x1877639248849536:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656700.363165:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656700.363188:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802355e00/0x9c3a6e82066ebedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b4b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.363242:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802355e00/0x9c3a6e82066ebedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b4b expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.363255:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802355e00/0x9c3a6e82066ebedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b4b expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.363265:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802355e00, rc 0) 00000100:00100000:0.0:1790656700.363352:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13833:x1877639248849536:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 212us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.363359:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:3.0:1790656700.368384:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656700.368488:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849664 00000100:00100000:1.0:1790656700.368510:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849664 00000100:00100000:1.0:1790656700.368700:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:1.0:1790656700.368712:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13833:x1877639248849664:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790656700.368758:0:14307:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790656700.368805:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790656700.368810:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790656700.368813:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790656700.368816:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790656700.379823:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13833:x1877639248849664:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 11095us (11437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.379843:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:2.0:1790656700.389910:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.390042:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849792 00000100:00100000:0.0:1790656700.390057:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849792 00000100:00100000:0.0:1790656700.390146:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:0.0:1790656700.390160:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13833:x1877639248849792:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790656700.390187:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656700.390213:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b52 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.390255:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.390268:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656700.390305:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354600, rc 0) 00000100:00100000:0.0:1790656700.390383:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13833:x1877639248849792:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 227us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.390391:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:3.0:1790656700.395553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.395856:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248849920 00000100:00100000:0.0:1790656700.395867:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248849920 00000100:00100000:0.0:1790656700.395931:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:0.0:1790656700.395943:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439371d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13833:x1877639248849920:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790656700.396239:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439371d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13833:x1877639248849920:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 296us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.396247:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:1.0:1790656700.402494:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656700.402726:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850048 00000100:00100000:2.0:1790656700.402741:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850048 00000100:00100000:2.0:1790656700.402800:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:2.0:1790656700.402811:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13833:x1877639248850048:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790656700.403115:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13833:x1877639248850048:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 305us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656700.403124:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:0.0:1790656700.430641:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656700.431701:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850176 00000100:00100000:2.0:1790656700.431712:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850176 00000100:00100000:2.0:1790656700.431775:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:2.0:1790656700.431785:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13844:x1877639248850176:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790656700.432130:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13844:x1877639248850176:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 345us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656700.432139:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:2.0:1790656700.435643:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.435739:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850304 00000100:00100000:0.0:1790656700.435748:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850304 00000100:00100000:0.0:1790656700.435801:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:0.0:1790656700.435812:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13844:x1877639248850304:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790656700.436079:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13844:x1877639248850304:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 268us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.436086:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:1.0:1790656700.446481:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656700.446946:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850432 00000100:00100000:3.0:1790656700.446957:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850432 00000100:00100000:3.0:1790656700.447009:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1790656700.447017:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2338:x1877639248850432:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790656700.447046:0:14313:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 29780b47-b3ec-4efd-87cc-984c89843686@192.168.203.23@tcp t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:3.0:1790656700.447085:0:14313:0:(genops.c:1384:class_connect()) connect: client 29780b47-b3ec-4efd-87cc-984c89843686, cookie 0x9c3a6e82066ebeed 00000004:00100000:3.0:1790656700.447116:0:14313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790656700.449556:0:14313:0:(import.c:65:import_set_state_nolock()) ffff943936646800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656700.450263:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+6:2338:x1877639248850432:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 3238us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656700.450276:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1790656700.465948:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656700.466012:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656700.466815:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850560 00000100:00100000:3.0:1790656700.466826:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850560 00000100:00100000:3.0:1790656700.466906:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850688 00000100:00100000:3.0:1790656700.466909:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850688 00000100:00100000:3.0:1790656700.466928:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656700.466936:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+7:0:x1877639248850560:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790656700.466968:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790656700.467035:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+7:0:x1877639248850560:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 99us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656700.467043:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656700.467060:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1790656700.467067:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248850688:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790656700.467078:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790656700.467115:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248850688:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 48us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656700.467120:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00080000:0.0:1790656700.467479:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656700.481183:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656700.481857:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850816 00000100:00100000:3.0:1790656700.481867:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850816 00000100:00100000:3.0:1790656700.481933:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656700.481944:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248850816:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790656700.482031:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248850816:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 90us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656700.482038:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656700.489020:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656700.489061:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656700.489093:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656700.489179:0:15726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248850944 00000100:00100000:0.0:1790656700.489189:0:15726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248850944 00000100:00100000:0.0:1790656700.489235:0:15726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851072 00000100:00100000:0.0:1790656700.489238:0:15726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851072 00000100:00100000:0.0:1790656700.489260:0:15726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:0.0:1790656700.489280:0:15726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2338:x1877639248850944:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790656700.489313:0:15726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 29780b47-b3ec-4efd-87cc-984c89843686@192.168.203.23@tcp t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:0.0:1790656700.489353:0:15726:0:(genops.c:1384:class_connect()) connect: client 29780b47-b3ec-4efd-87cc-984c89843686, cookie 0x9c3a6e82066ebef4 00002000:00100000:0.0:1790656700.489365:0:15726:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 29780b47-b3ec-4efd-87cc-984c89843686/ffff943802758000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790656700.489375:0:15726:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790656700.489478:0:15726:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790656700.489507:0:15726:0:(import.c:65:import_set_state_nolock()) ffff943802758800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790656700.489580:0:15726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:29780b47-b3ec-4efd-87cc-984c89843686+6:2338:x1877639248850944:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 299us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656700.489588:0:15726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1790656700.489813:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656700.489819:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2338:x1877639248851072:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790656700.489837:0:14999:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 29780b47-b3ec-4efd-87cc-984c89843686@192.168.203.23@tcp t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:3.0:1790656700.489867:0:14999:0:(genops.c:1384:class_connect()) connect: client 29780b47-b3ec-4efd-87cc-984c89843686, cookie 0x9c3a6e82066ebefb 00002000:00100000:3.0:1790656700.489873:0:14999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 29780b47-b3ec-4efd-87cc-984c89843686/ffff943936647000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790656700.489881:0:14999:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790656700.490058:0:14999:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790656700.490074:0:14999:0:(import.c:65:import_set_state_nolock()) ffff943936642800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790656700.490100:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2338:x1877639248851072:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 279us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656700.490106:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1790656700.491025:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851200 00000100:00100000:1.0:1790656700.491033:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851200 00000100:00100000:1.0:1790656700.491076:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1790656700.491085:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248851200:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790656700.491147:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790656700.491294:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:13833:x1877639248851200:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 210us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656700.491302:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000001:00100000:0.0:1790656700.634262:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 29780b47-b3ec-4efd-87cc-984c89843686 00000001:00100000:0.0:1790656700.634657:0:6716:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e04176dd-0835-45f2-9651-67d83fe9deba 00000100:00100000:3.0:1790656700.756213:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656700.756334:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851328 00000100:00100000:1.0:1790656700.756344:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851328 00000100:00100000:1.0:1790656700.756407:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1790656700.756418:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+6:13865:x1877639248851328:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:1.0:1790656700.756438:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656700.756467:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06400/0x9c3a6e82066ebf02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b7c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756549:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756564:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756576:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656700.756662:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790656700.756667:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656700.756688:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756720:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06400/0x9c3a6e82066ebf02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756862:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656700.756873:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:1.0:1790656700.756876:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790656700.756880:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943801f06e00, rc 0) 00000100:00100000:1.0:1790656700.756998:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+7:13865:x1877639248851328:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 581us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656700.757006:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:3.0:1790656701.279489:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656701.599300:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269810560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656701.599381:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656701.599554:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810560 00000100:00100000:2.0:1790656701.599562:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810560 00000100:00100000:2.0:1790656701.599658:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790656701.599668:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269810560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656701.599690:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656701.599875:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269810560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656701.599882:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790656701.600082:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269810560:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656701.600224:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790656702.302937:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790656702.683303:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e04176dd-0835-45f2-9651-67d83fe9deba 00000001:00100000:0.0:1790656702.683322:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 29780b47-b3ec-4efd-87cc-984c89843686 00010000:00010000:3.0:1790656703.330664:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790656703.585475:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790656703.647957:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269810688:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648081:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269811200:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648134:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790656703.648139:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269810816:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648183:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648204:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269811328:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648251:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269810944:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648290:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790656703.648295:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269811072:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656703.648343:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810688 00000100:00100000:0.0:1790656703.648351:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810688 00000100:00100000:0.0:1790656703.648399:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790656703.648409:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3301:x1877639269810688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648458:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3301:x1877639269810688:12345-0@lo:400:kworker.0 Request processed in 50us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.648465:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790656703.648498:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811200 00000100:00100000:0.0:1790656703.648502:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811200 00000100:00100000:0.0:1790656703.648540:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811328 00000100:00100000:0.0:1790656703.648543:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811328 00000100:00100000:0.0:1790656703.648556:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811072 00000100:00100000:0.0:1790656703.648559:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811072 00000100:00100000:0.0:1790656703.648572:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790656703.648578:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269811200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648637:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877639269811200:12345-0@lo:400:kworker.0 Request processed in 59us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.648655:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790656703.648670:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790656703.648683:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269811328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648875:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877639269811328:12345-0@lo:400:kworker.0 Request processed in 191us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.648882:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790656703.648897:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656703.648903:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269811072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.648934:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877639269811072:12345-0@lo:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.648940:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790656703.648959:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810816 00000100:00100000:0.0:1790656703.648962:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810816 00000100:00100000:0.0:1790656703.648986:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269810944 00000100:00100000:0.0:1790656703.648989:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269810944 00000100:00100000:0.0:1790656703.649006:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656703.649012:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269810816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649042:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269810816:12345-0@lo:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.649047:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790656703.649059:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656703.649065:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269810944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649091:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269810944:12345-0@lo:400:kworker.0 Request processed in 27us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656703.649097:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790656703.649125:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656703.649129:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656703.649131:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656703.649165:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877639269811072:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649184:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790656703.649199:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269810944:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649229:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269810816:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649238:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1877639269811328:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649247:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269810688:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.649256:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1877639269811200:0@lo:400:kworker.0 00000100:00100000:0.0:1790656703.650981:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790656703.650997:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269811456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790656703.651050:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656703.651142:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811456 00000100:00100000:2.0:1790656703.651149:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811456 00000100:00100000:2.0:1790656703.651196:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790656703.651210:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269811456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656703.651241:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656703.651286:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269811456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656703.651292:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790656703.651331:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269811456:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1790656703.734134:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 29780b47-b3ec-4efd-87cc-984c89843686 00000001:02000400:1.0:1790656703.965544:0:16277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790656704.350961:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656705.377384:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656705.787853:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787893:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787916:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787942:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787961:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787977:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.787995:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656705.788019:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851456 00000100:00100000:1.0:1790656705.788027:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851456 00000100:00100000:1.0:1790656705.788069:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:1.0:1790656705.788078:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2340:x1877639248851456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1790656705.788145:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2340:x1877639248851456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656705.788154:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:2.0:1790656705.788399:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851584 00000100:00100000:2.0:1790656705.788404:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851584 00000100:00100000:2.0:1790656705.788445:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851968 00000100:00100000:2.0:1790656705.788453:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851968 00000100:00100000:2.0:1790656705.788475:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656705.788481:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:2340:x1877639248851584:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788531:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:2340:x1877639248851584:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 50us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788538:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656705.788549:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1790656705.788555:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2340:x1877639248851968:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788575:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2340:x1877639248851968:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 20us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788580:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1790656705.788613:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851840 00000100:00100000:2.0:1790656705.788617:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851840 00000100:00100000:2.0:1790656705.788633:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852096 00000100:00100000:2.0:1790656705.788636:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852096 00000100:00100000:2.0:1790656705.788648:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248851712 00000100:00100000:2.0:1790656705.788650:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248851712 00000100:00100000:2.0:1790656705.788660:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852224 00000100:00100000:2.0:1790656705.788663:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852224 00000100:00100000:2.0:1790656705.788674:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1790656705.788680:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248851840:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788705:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248851840:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788711:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1790656705.788722:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656705.788728:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248852096:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788762:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248852096:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788768:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656705.788779:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656705.788784:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248851712:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788816:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248851712:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788821:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656705.788832:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1790656705.788837:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248852224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656705.788859:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248852224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656705.788864:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00080000:1.0:1790656705.789709:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790656705.789714:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790656705.789717:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790656706.398863:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656706.719010:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269811584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656706.719087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656706.719335:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811584 00000100:00100000:3.0:1790656706.719344:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811584 00000100:00100000:3.0:1790656706.719404:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790656706.719413:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269811584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656706.719455:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790656706.719509:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269811584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656706.719516:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790656706.720008:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790656706.720053:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269811584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790656707.422834:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790656708.234394:0:16425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5d3a8c40 20000000:00000080:0.0:1790656708.234412:0:16425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94380355d400 uarg=0000000000000000 20000000:01000000:0.0:1790656708.234446:0:16425:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790656708.234452:0:16425:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790656708.234457:0:16425:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790656708.239811:0:16426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1790656708.240012:0:16425:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790656708.246461:0:16425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790656708.246499:0:16425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246520:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246529:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246553:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246563:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246570:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246578:0:16425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246983:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.246999:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 12 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.247012:0:16425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811712:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656708.247405:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.247414:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 12 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.247423:0:16425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811840:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656708.247455:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.247487:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.247497:0:16425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811968:0@lo:104: 00000100:00100000:1.0:1790656708.247541:0:16425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656708.247630:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.247638:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 18 pid: 14307 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.247646:0:16425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269812096:0@lo:104: 00000100:00100000:1.0:1790656708.247678:0:16425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790656708.250693:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.250878:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 18 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.250892:0:16425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269812224:0@lo:104: 00000100:00100000:1.0:1790656708.250947:0:16425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656708.252498:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269811968 00000100:00100000:0.0:1790656708.252510:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269811968 00000100:00100000:0.0:1790656708.254813:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812096 00000100:00100000:0.0:1790656708.254824:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812096 00000100:00100000:0.0:1790656708.254872:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656708.254881:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+4:16425:x1877639269811968:12345-0@lo:104: 00010000:00010000:0.0:1790656708.254899:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.254988:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656708.254995:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+4:16425:x1877639269811968:12345-0@lo:104: Request processed in 116us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656708.255002:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656708.255021:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656708.255029:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:16425:x1877639269812096:12345-0@lo:104: 00010000:00010000:0.0:1790656708.255036:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255072:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790656708.255077:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:16425:x1877639269812096:12345-0@lo:104: Request processed in 50us (7399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656708.255082:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790656708.255416:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790656708.255422:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255431:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06600 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656708.255435:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255444:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656708.255462:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656708.255469:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656708.255512:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255519:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656708.255537:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255545:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943801f06600/0x9c3a6e82066ebd81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebd88 expref: -99 pid: 15712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255557:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656708.255561:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255567:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480000 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:0.0:1790656708.255570:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255577:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790656708.255583:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656708.255588:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790656708.255628:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255634:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790656708.255641:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.255648:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943928480000/0x9c3a6e82066ebc4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc54 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.256461:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656708.256464:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656708.256465:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656708.256500:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269812352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656708.256545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656708.256584:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790656708.256606:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269812480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656708.256623:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656708.256654:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812352 00000100:00100000:0.0:1790656708.256670:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812352 00010000:00010000:0.0:1790656708.256692:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 19 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656708.256710:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812480 00000100:00100000:0.0:1790656708.256712:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812480 00010000:00010000:0.0:1790656708.256721:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 20 pid: 14307 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656708.256732:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656708.256738:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+20:3301:x1877639269812352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656708.256758:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656708.256763:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 20 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.256773:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 20 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.256790:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656708.256818:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+20:3301:x1877639269812352:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656708.256825:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790656708.256838:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656708.256844:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3301:x1877639269812480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790656708.256850:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656708.256854:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 19 pid: 14307 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.256862:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 19 pid: 14307 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.256870:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656708.256887:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3301:x1877639269812480:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656708.256892:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790656708.256922:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269812480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790656708.256930:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3301:1877639269812352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790656708.258330:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656708.258803:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656708.259096:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852352 00000100:00100000:2.0:1790656708.259104:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852352 00010000:00010000:2.0:1790656708.259136:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 13 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656708.259166:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656708.259175:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2342:x1877639248852352:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656708.259188:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656708.259193:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 13 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656708.259230:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 13 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656708.259249:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656708.259297:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2342:x1877639248852352:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 124us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656708.259305:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1790656708.259759:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656708.259891:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852480 00000100:00100000:2.0:1790656708.259896:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852480 00010000:00010000:2.0:1790656708.259912:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 13 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656708.259930:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1790656708.259936:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2342:x1877639248852480:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656708.259944:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656708.259948:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 13 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656708.259956:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 13 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656708.259967:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656708.259991:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2342:x1877639248852480:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 54us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656708.259997:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1790656708.262558:0:16425:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bcec00 going to sleep for 11 seconds 00010000:00010000:1.0:1790656708.262631:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943802354600/0x9c3a6e82066ebee6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b52 expref: 12 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.262649:0:16425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811712:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656708.262668:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943802354400/0x9c3a6e82066ebeae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237af0 expref: 11 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.262696:0:16425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811840:192.168.203.23@tcp:104: 00010000:00010000:1.0:1790656708.262710:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943928481200/0x9c3a6e82066ebd88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebd81 expref: 18 pid: 14305 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.262718:0:16425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269811968:0@lo:104: 00010000:00010000:1.0:1790656708.262727:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943801f07a00/0x9c3a6e82066ebc54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebc4d expref: 17 pid: 14307 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.262735:0:16425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9439280c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269812096:0@lo:104: 00000100:00100000:0.0:1790656708.267496:0:14297:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790656708.267523:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812224 00000100:00100000:0.0:1790656708.267532:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812224 00000100:00100000:0.0:1790656708.267653:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790656708.267670:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bc3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:16425:x1877639269812224:12345-0@lo:104: 00010000:00010000:0.0:1790656708.267686:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656708.267787:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790656708.267793:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bc3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+3:16425:x1877639269812224:12345-0@lo:104: Request processed in 127us (16847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656708.267798:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1790656708.267872:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790656708.267878:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.267886:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943801f06200 already unused, calling callback (ffffffffc1ce1c20) 10000000:00010000:3.0:1790656708.267890:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656708.267897:0:16425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1877639269812224:0@lo:104: 00010000:00010000:3.0:1790656708.267898:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790656708.267905:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656708.267910:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790656708.267928:0:16425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.267956:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.267972:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790656708.268002:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.268009:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff943801f06200/0x9c3a6e82066ebc00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c3a6e82066ebc07 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.268025:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656708.268027:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790656708.268028:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790656708.268031:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269812608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790656708.268066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656708.269086:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812608 00000100:00100000:3.0:1790656708.269095:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812608 00010000:00010000:3.0:1790656708.269121:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 17 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656708.269374:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790656708.269385:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:3299:x1877639269812608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790656708.269399:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656708.269405:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 17 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269418:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 17 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269434:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943801f07e00/0x9c3a6e82066ebc07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c3a6e82066ebc00 expref: 17 pid: 14308 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269452:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269486:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269502:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269508:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269514:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269519:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269525:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656708.269528:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269536:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269558:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656708.269567:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656708.269653:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:3299:x1877639269812608:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656708.269660:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790656708.271537:0:16425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.271553:0:16425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656708.271562:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656708.277373:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3299:1877639269812608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790656708.446672:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656708.767679:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790656708.767714:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269812736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656708.767911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656708.767975:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812736 00000100:00100000:2.0:1790656708.767982:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812736 00000100:00100000:2.0:1790656708.768029:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656708.768037:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269812736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790656708.768067:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790656708.768107:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269812736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656708.768113:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790656708.768344:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269812736:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790656708.768647:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790656708.768878:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269812864:0@lo:400:kworker.0 00000100:00100000:1.0:1790656708.768918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656708.768949:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790656708.768955:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269812992:0@lo:400:kworker.0 00000100:00100000:1.0:1790656708.768980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656708.769009:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812992 00000100:00100000:1.0:1790656708.769014:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812992 00000100:00100000:1.0:1790656708.769046:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656708.769053:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269812992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656708.769093:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269812992:12345-0@lo:400:kworker.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656708.769100:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790656708.769131:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269812992:0@lo:400:kworker.0 00000100:00100000:3.0:1790656708.769394:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269813248:0@lo:400:kworker.0 00000100:00100000:3.0:1790656708.769438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656708.769460:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790656708.769465:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269813120:0@lo:400:kworker.0 00000100:00100000:3.0:1790656708.769497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656708.769523:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813248 00000100:00100000:3.0:1790656708.769528:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813248 00000100:00100000:3.0:1790656708.769553:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813120 00000100:00100000:3.0:1790656708.769556:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813120 00000100:00100000:3.0:1790656708.769574:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790656708.769580:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269813248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656708.769634:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1877639269813248:12345-0@lo:400:kworker.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656708.769641:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790656708.770049:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790656708.770059:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269813120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656708.770093:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877639269813120:12345-0@lo:400:kworker.0 Request processed in 36us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656708.770099:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790656708.770177:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1877639269813120:0@lo:400:kworker.0 00000100:00100000:3.0:1790656708.770187:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1877639269813248:0@lo:400:kworker.0 00000100:00080000:0.0:1790656708.770382:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656708.770519:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269812864 00000100:00100000:2.0:1790656708.770525:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269812864 00000100:00100000:2.0:1790656708.770574:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790656708.770581:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269812864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790656708.770643:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269812864:12345-0@lo:400:kworker.0 Request processed in 62us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656708.770650:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790656708.770924:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269812864:0@lo:400:kworker.0 00000100:00080000:0.0:1790656708.771099:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790656709.477612:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656709.946297:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656709.946444:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852608 00000100:00100000:1.0:1790656709.946454:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852608 00000100:00100000:1.0:1790656709.946519:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:1.0:1790656709.946529:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+11:13717:x1877639248852608:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656709.946553:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656709.946571:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b83 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656709.946621:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b83 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656709.946643:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900030a00/0x9c3a6e82066ebf17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b83 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656709.946653:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030a00, rc 0) 00000100:00100000:1.0:1790656709.946723:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852608:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 195us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656709.946730:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:2.0:1790656709.955937:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656709.955992:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852736 00000100:00100000:1.0:1790656709.956012:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852736 00000100:00100000:1.0:1790656709.956086:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:1.0:1790656709.956099:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852736:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656709.957191:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852736:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 1087us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656709.957203:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:3.0:1790656709.960534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656709.960800:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852864 00000100:00100000:0.0:1790656709.960827:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852864 00000100:00100000:1.0:1790656709.961132:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:1.0:1790656709.961148:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852864:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656709.961455:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852864:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 311us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656709.961474:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:1.0:1790656709.972795:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656709.978531:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248852992 00000100:00100000:3.0:1790656709.978547:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248852992 00000100:00100000:3.0:1790656709.978628:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:3.0:1790656709.978637:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+12:13717:x1877639248852992:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656709.978653:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656709.978670:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97a00/0x9c3a6e82066ebf1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b8a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656709.978716:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97a00/0x9c3a6e82066ebf1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b8a expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656709.978727:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97a00/0x9c3a6e82066ebf1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b8a expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656709.978736:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97a00, rc 0) 00000100:00100000:3.0:1790656709.978801:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13717:x1877639248852992:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 165us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656709.978808:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:3.0:1790656709.984816:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656709.984922:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853120 00000100:00100000:1.0:1790656709.984941:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853120 00000100:00100000:1.0:1790656709.985013:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:1.0:1790656709.985025:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13717:x1877639248853120:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656709.985416:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13717:x1877639248853120:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 392us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656709.985424:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:2.0:1790656709.992587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656709.992732:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853248 00000100:00100000:1.0:1790656709.992745:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853248 00000100:00100000:1.0:1790656709.992824:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:1.0:1790656709.992836:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13717:x1877639248853248:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656709.993117:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:13717:x1877639248853248:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 282us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656709.993126:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 10000000:01000000:3.0:1790656710.047770:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656710.047779:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943802a64800 from 10 10000000:01000000:3.0:1790656710.047785:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656710.047844:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.047859:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.047873:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656710.047908:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.047996:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656710.048079:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94000 going to sleep for 11 seconds 00000100:00100000:0.0:1790656710.048247:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813376 00000100:00100000:0.0:1790656710.048257:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813376 00000100:00100000:0.0:1790656710.048328:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790656710.048340:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+16:14311:x1877639269813376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790656710.048357:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656710.048373:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943802354000/0x9c3a6e82066ebf2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebf25 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.048404:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943802354000/0x9c3a6e82066ebf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf25 expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.048433:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943802354000/0x9c3a6e82066ebf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf25 expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.048443:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354000, rc 0) 00000100:00100000:0.0:1790656710.048508:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656710.048515:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790656710.048683:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656710.048711:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf2c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.048721:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebf2c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656710.048785:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.048814:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656710.048847:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94000 going to sleep for 11 seconds 00000100:00100000:3.0:1790656710.048864:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813504 00000100:00100000:3.0:1790656710.048868:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813504 00000100:00100000:3.0:1790656710.048896:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790656710.048902:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.049353:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656710.049361:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790656710.049397:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.049430:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.049488:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656710.049502:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393bf94000 going to sleep for 11 seconds 00000100:00100000:3.0:1790656710.049517:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813632 00000100:00100000:3.0:1790656710.049521:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813632 00000100:00100000:3.0:1790656710.049540:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790656710.049546:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.049748:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656710.049766:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790656710.049802:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790656710.051716:0:16496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790656710.052240:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790656710.052266:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790656710.052279:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf2c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.052293:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c97e00/0x9c3a6e82066ebf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf2c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790656710.052306:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790656710.052309:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94393bc2a800 from 10 10000000:01000000:0.0:1790656710.052312:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790656710.052361:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.052370:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.052383:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656710.052415:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790656710.052515:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656710.052575:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620600 going to sleep for 11 seconds 00000100:00100000:3.0:1790656710.053681:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813760 00000100:00100000:3.0:1790656710.053696:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813760 00000100:00100000:3.0:1790656710.053764:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790656710.053775:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439281afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+17:14311:x1877639269813760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790656710.053796:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656710.053817:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943907c97400/0x9c3a6e82066ebf3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebf33 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.053850:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943907c97400/0x9c3a6e82066ebf3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf33 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.053863:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943907c97400/0x9c3a6e82066ebf3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf33 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.053873:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97400, rc 0) 00000100:00100000:3.0:1790656710.053955:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439281afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269813760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656710.053963:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790656710.056432:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bfa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790656710.056479:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf3a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656710.056495:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebf3a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656710.056632:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656710.056701:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656710.056748:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907f1b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790656710.056833:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269813888 00000100:00100000:1.0:1790656710.056842:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269813888 00000100:00100000:1.0:1790656710.056892:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790656710.056902:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269813888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.057299:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269813888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656710.057308:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790656710.057687:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269813888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790656710.057734:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790656710.057787:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656710.057813:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907f1b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790656710.058117:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269814016 00000100:00100000:1.0:1790656710.058124:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269814016 00000100:00100000:1.0:1790656710.058166:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790656710.058175:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269814016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.060768:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269814016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2578us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656710.060788:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790656710.063160:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bb0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790656710.068541:0:16498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790656710.072544:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790656710.072581:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790656710.072617:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf3a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.072649:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943802354c00/0x9c3a6e82066ebf33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf3a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790656710.072662:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790656710.072665:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943907838800 from 10 10000000:01000000:3.0:1790656710.072668:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790656710.072718:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.072726:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656710.072740:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656710.072772:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790656710.072860:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656710.072916:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff94393c8de300 going to sleep for 11 seconds 00000100:00100000:1.0:1790656710.072991:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269814144 00000100:00100000:1.0:1790656710.073002:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269814144 00000100:00100000:1.0:1790656710.073120:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790656710.073130:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+18:14311:x1877639269814144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656710.073147:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656710.073162:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943900031600/0x9c3a6e82066ebf48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c3a6e82066ebf41 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656710.073189:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943900031600/0x9c3a6e82066ebf48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf41 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656710.073201:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943900031600/0x9c3a6e82066ebf48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c3a6e82066ebf41 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656710.073210:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031600, rc 0) 00000100:00100000:1.0:1790656710.073254:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269814144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656710.073259:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790656710.073306:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790656710.073323:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf48 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656710.073333:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c3a6e82066ebf48 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656710.073388:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.073412:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656710.073424:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bce900 going to sleep for 11 seconds 00000100:00100000:1.0:1790656710.073448:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269814272 00000100:00100000:1.0:1790656710.073453:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269814272 00000100:00100000:1.0:1790656710.073489:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790656710.073496:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269814272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.073801:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269814272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656710.073807:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790656710.073836:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.073868:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.073909:0:14311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790656710.073921:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff943909bce900 going to sleep for 11 seconds 00000100:00100000:1.0:1790656710.073932:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269814400 00000100:00100000:1.0:1790656710.073936:0:14307:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269814400 00000100:00100000:1.0:1790656710.073954:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790656710.073959:0:14307:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269814400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790656710.078038:0:14307:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:14311:x1877639269814400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4065us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656710.078054:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790656710.080949:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:14311:1877639269814400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790656710.084432:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790656710.084698:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790656710.084726:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790656710.084739:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf48 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656710.084753:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff943907c96600/0x9c3a6e82066ebf41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c3a6e82066ebf48 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656710.499823:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656710.914244:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656710.914295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656710.914318:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853376 00000100:00100000:2.0:1790656710.914330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656710.914364:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656710.914389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656710.914417:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656710.914431:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853376 00000100:00100000:2.0:1790656710.914440:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853632 00000100:00100000:2.0:1790656710.914445:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853632 00000100:00100000:3.0:1790656710.914521:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853888 00000100:00100000:3.0:1790656710.914526:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853888 00000100:00100000:1.0:1790656710.914529:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853760 00000100:00100000:1.0:1790656710.914535:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853760 00000100:00100000:0.0:1790656710.914585:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248853504 00000100:00100000:0.0:1790656710.914612:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248853504 00000100:00100000:2.0:1790656710.917099:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854016 00000100:00100000:2.0:1790656710.917115:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854016 00000100:00100000:2.0:1790656710.917153:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656710.917165:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248853632:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656710.917279:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248853632:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 115us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656710.917286:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656710.917306:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1790656710.917312:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2339:x1877639248854016:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656710.917359:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29780b47-b3ec-4efd-87cc-984c89843686+5:2339:x1877639248854016:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 47us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656710.917366:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1790656710.918204:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1790656710.919008:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656710.919023:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2339:x1877639248853504:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656710.919119:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2339:x1877639248853504:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 100us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656710.919128:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1790656710.921779:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:2340:x1877639248853376:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656710.921900:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+6:2340:x1877639248853376:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 3684us (7668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656710.921915:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00080000:0.0:1790656710.921916:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656710.921927:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790656710.921931:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656710.923349:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656710.923370:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248853888:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1790656710.923453:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248853888:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (9122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656710.923472:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1790656710.935198:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1790656710.935225:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:2339:x1877639248853760:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1790656710.936549:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29780b47-b3ec-4efd-87cc-984c89843686+6:2339:x1877639248853760:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1323us (22145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656710.936565:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00010000:00010000:3.0:1790656711.520063:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656711.839911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790656711.839942:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269814528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656711.840030:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790656711.841848:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269814528 00000100:00100000:3.0:1790656711.841866:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269814528 00000100:00100000:3.0:1790656711.841978:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790656711.841995:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269814528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790656711.842046:0:15000:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790656711.842048:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656711.842162:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269814528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656711.842171:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790656711.842230:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269814528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790656711.866334:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656711.867032:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854144 00000100:00100000:3.0:1790656711.867047:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854144 00000100:00100000:3.0:1790656711.867129:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1790656711.867141:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+6:14375:x1877639248854144:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656711.867169:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656711.867202:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b91 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867288:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867305:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867322:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867339:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867346:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.867373:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.869954:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066ebf64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.869983:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066ebf64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.869997:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066ebf64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656711.870041:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790656711.870046:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656711.870097:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066ebf64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870110:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870118:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870126:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870133:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656711.870138:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870147:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870177:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:3.0:1790656711.870181:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.870188:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870194:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ebf56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870211:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870217:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870223:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870228:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656711.870232:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870238:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870245:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff943907fdc100) 00010000:00010000:3.0:1790656711.870247:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.870250:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870256:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97200/0x9c3a6e82066ebf5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870318:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b91 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870335:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96800/0x9c3a6e82066ebf64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b91 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.870343:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943907fdc800) 00010000:00010000:3.0:1790656711.870345:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656711.870348:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96800, rc 0) 00000100:00100000:3.0:1790656711.870462:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+7:14375:x1877639248854144:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3312us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656711.870472:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1790656711.877819:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656711.878342:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854400 00000100:00100000:3.0:1790656711.878358:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854400 00000100:00100000:3.0:1790656711.878439:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1790656711.878460:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+7:14375:x1877639248854400:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656711.878491:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656711.878519:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ebf6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b98 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.878652:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.880657:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.881258:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.885151:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.885176:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.885190:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889128:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066ebf80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889160:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066ebf80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889175:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066ebf80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656711.889201:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790656711.889474:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889483:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889491:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889498:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656711.889504:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889513:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889528:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943907fdc800) 00010000:00010000:2.0:1790656711.889531:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656711.889536:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889540:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ebf72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889553:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889556:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889568:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889572:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656711.889573:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889577:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889584:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff943907fdc100) 00010000:00010000:2.0:1790656711.889653:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656711.889658:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.889665:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97600/0x9c3a6e82066ebf79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.890324:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ebf6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b98 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.890347:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480000/0x9c3a6e82066ebf80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b98 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.890356:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943909b4aa00) 00010000:00010000:2.0:1790656711.890358:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656711.890361:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480000, rc 0) 00000100:00100000:2.0:1790656711.890477:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14375:x1877639248854400:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 12026us (12672us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790656711.890499:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1790656711.901557:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656711.905970:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854528 00000100:00100000:3.0:1790656711.905994:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854528 00000100:00100000:2.0:1790656711.906521:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1790656711.906536:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+9:14375:x1877639248854528:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790656711.906725:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+9:14375:x1877639248854528:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 192us (5483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656711.906734:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1790656711.947537:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656711.947837:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854656 00000100:00100000:2.0:1790656711.947850:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854656 00000100:00100000:2.0:1790656711.947979:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1790656711.947993:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14381:x1877639248854656:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1790656711.948020:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656711.948046:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ebf8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237b9f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948123:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948139:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948152:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948169:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948176:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.948200:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949108:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949125:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949134:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949141:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656711.949146:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949155:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949174:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:3.0:1790656711.949178:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.949184:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949199:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ebf95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949215:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949222:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949228:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949233:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656711.949418:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949430:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949439:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943909b4af00) 00010000:00010000:3.0:1790656711.949442:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.949446:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949462:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ebf9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949517:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ebf8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b9f expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949541:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:3.0:1790656711.949544:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.949548:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ebf8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b9f expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.949558:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481200, rc 0) 00000100:00100000:3.0:1790656711.950322:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14381:x1877639248854656:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2324us (2793us total) trans 0 rc 301/301 00000100:00100000:3.0:1790656711.950335:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1790656711.956902:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656711.957108:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248854784 00000100:00100000:0.0:1790656711.957123:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248854784 00000100:00100000:0.0:1790656711.957197:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656711.957210:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14381:x1877639248854784:12345-192.168.203.23@tcp:700:lfs.0 00000100:00100000:0.0:1790656711.957459:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14381:x1877639248854784:12345-192.168.203.23@tcp:700:lfs.0 Request processed in 242us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656711.957468:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1790656711.959038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656711.959161:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855040 00000100:00100000:2.0:1790656711.959172:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855040 00000100:00100000:2.0:1790656711.959253:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1790656711.959266:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+9:14381:x1877639248855040:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:2.0:1790656711.959339:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656711.959373:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ebed1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b1a expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.959397:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:2.0:1790656711.959404:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790656711.960232:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.960267:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 5 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.960278:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.960326:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 5 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.960345:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 5 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656711.960381:0:14315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269814656:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656711.960516:0:14315:0:(client.c:2716:ptlrpc_set_wait()) set ffff943907f1b600 going to sleep for 11 seconds 00000100:00100000:2.0:1790656711.966544:0:14315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269814656:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656711.966584:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656711.970271:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656711.970375:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855168 00000100:00100000:2.0:1790656711.970389:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855168 00010000:00010000:2.0:1790656711.970443:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 6 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656711.970510:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1790656711.970521:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2342:x1877639248855168:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656711.970539:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656711.970547:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 6 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970562:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 6 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970623:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943801f06e00/0x9c3a6e82066ebf09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237b7c expref: 6 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970649:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:2.0:1790656711.970657:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970686:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970696:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656711.970737:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656711.970801:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29780b47-b3ec-4efd-87cc-984c89843686+5:2342:x1877639248855168:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 280us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656711.970809:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00010000:00010000:3.0:1790656711.971643:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.971658:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.971693:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.971706:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.971717:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656711.977570:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790656711.978580:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978771:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978799:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978807:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1790656711.978812:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978822:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978843:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943910d36200) 00010000:00010000:3.0:1790656711.978847:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790656711.978854:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656711.978861:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481400/0x9c3a6e82066ebfa3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790656711.979346:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ae1c73 reply state 000000007cef8db8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656711.979362:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656711.979875:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+10:14381:x1877639248855040:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 20604us (20840us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790656711.979888:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:0.0:1790656711.998873:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998898:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998907:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998935:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656711.998941:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998950:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998973:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943907fdc900) 00010000:00010000:0.0:1790656711.998977:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656711.998983:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656711.998990:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfaa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656712.048924:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.049259:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855296 00000100:00100000:3.0:1790656712.049273:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855296 00000100:00080000:0.0:1790656712.049364:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790656712.049397:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1790656712.049412:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+9:14389:x1877639248855296:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:3.0:1790656712.049478:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656712.049511:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237ba6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049632:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066ebfb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049650:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066ebfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049662:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066ebfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656712.049707:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790656712.049712:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656712.049762:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066ebfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049792:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ba6 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049813:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96400/0x9c3a6e82066ebfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237ba6 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.049823:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:3.0:1790656712.049826:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656712.049830:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96400, rc 0) 00000100:00100000:3.0:1790656712.049916:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+10:14389:x1877639248855296:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 509us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.049935:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1790656712.080206:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.080338:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855424 00000100:00100000:3.0:1790656712.080353:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855424 00000100:00100000:3.0:1790656712.080488:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1790656712.080500:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+5:14390:x1877639248855424:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656712.080526:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656712.080552:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bad expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.080745:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.080764:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.080779:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656712.080824:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790656712.080829:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790656712.080851:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.080879:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bad expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.081040:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96000/0x9c3a6e82066ebfc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bad expref: 6 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.081073:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:3.0:1790656712.081076:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790656712.081080:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96000, rc 0) 00000100:00100000:3.0:1790656712.081209:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:14390:x1877639248855424:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 710us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.081216:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00080000:0.0:1790656712.081297:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656712.084142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.084309:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855552 00000100:00100000:0.0:1790656712.084324:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855552 00000100:00100000:0.0:1790656712.084407:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1790656712.084420:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+6:14390:x1877639248855552:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656712.084459:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656712.084486:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebfcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bb4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084570:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084624:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084673:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084700:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084709:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.084717:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088051:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088077:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088091:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656712.088152:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656712.088157:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656712.088181:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088195:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088202:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088225:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088232:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656712.088236:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088244:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088257:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:0.0:1790656712.088261:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656712.088265:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088272:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ebfd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088289:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088297:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088303:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088308:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656712.088311:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088328:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088337:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943910d36e00) 00010000:00010000:0.0:1790656712.088339:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656712.088343:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088349:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ebfdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088388:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebfcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bb4 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088409:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bb4 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.088417:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36900) 00010000:00010000:0.0:1790656712.088420:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656712.088422:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354600, rc 0) 00000100:00100000:0.0:1790656712.088520:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+7:14390:x1877639248855552:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4102us (4395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656712.088530:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1790656712.095162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.095268:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248855808 00000100:00100000:3.0:1790656712.095283:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248855808 00000100:00100000:3.0:1790656712.095390:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:3.0:1790656712.095403:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+7:14390:x1877639248855808:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656712.095432:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656712.095467:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bbb expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656712.095626:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790656712.095804:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfe9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bbb expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.095823:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:3.0:1790656712.095827:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790656712.095833:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebfe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bbb expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.095851:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:3.0:1790656712.095935:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+8:14390:x1877639248855808:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 534us (787us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790656712.095966:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1790656712.111265:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.111394:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248856064 00000100:00100000:0.0:1790656712.111407:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248856064 00000100:00100000:0.0:1790656712.111493:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1790656712.111506:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+8:14390:x1877639248856064:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:0.0:1790656712.111833:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656712.111866:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ebfe2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bb4 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.111890:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36900) 00010000:00010000:0.0:1790656712.111902:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656712.111933:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.111948:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.111961:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656712.112298:0:14313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070a55dd1 reply state 00000000399d7821 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656712.112312:0:14313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790656712.112321:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790656712.112435:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+9:14390:x1877639248856064:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 931us (1182us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790656712.112443:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00010000:00010000:0.0:1790656712.113915:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.113933:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.113951:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.113977:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656712.113983:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.113992:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.114012:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:0.0:1790656712.114016:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790656712.114021:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.114028:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ebff7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656712.115052:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.115211:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248856320 00000100:00100000:3.0:1790656712.115224:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248856320 00000100:00100000:3.0:1790656712.115290:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656712.115302:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29780b47-b3ec-4efd-87cc-984c89843686+8:14390:x1877639248856320:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656712.115741:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29780b47-b3ec-4efd-87cc-984c89843686+9:14390:x1877639248856320:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 439us (698us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790656712.115755:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1790656712.117853:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.118146:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248856576 00000100:00100000:3.0:1790656712.118160:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248856576 00000100:00100000:3.0:1790656712.118229:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1790656712.118240:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+9:14390:x1877639248856576:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656712.118273:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656712.118299:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bc2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118392:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118410:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118423:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118438:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118479:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.118487:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656712.119099:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790656712.119340:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119351:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119359:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119367:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656712.119373:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119381:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119414:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:2.0:1790656712.119417:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656712.119424:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119430:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96e00/0x9c3a6e82066ec005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119445:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119462:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119468:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119473:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656712.119476:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119483:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119491:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943907fdcc00) 00010000:00010000:2.0:1790656712.119493:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656712.119496:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119502:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96c00/0x9c3a6e82066ec00c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119570:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebffe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc2 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.119582:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:2.0:1790656712.119585:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790656712.119588:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97800/0x9c3a6e82066ebffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc2 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.120266:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97800, rc 0) 00000100:00100000:2.0:1790656712.120410:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+10:14390:x1877639248856576:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2168us (2569us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790656712.120420:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1790656712.130492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.138146:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248856704 00000100:00100000:0.0:1790656712.138172:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248856704 00000100:00100000:0.0:1790656712.138295:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1790656712.138308:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+10:14390:x1877639248856704:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1790656712.138344:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656712.138375:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ec01a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bc9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138525:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138543:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138556:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656712.138609:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790656712.138613:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656712.138634:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138667:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354800/0x9c3a6e82066ec01a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138690:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.138701:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:0.0:1790656712.138705:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790656712.138710:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354600, rc 0) 00000100:00100000:0.0:1790656712.139317:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29780b47-b3ec-4efd-87cc-984c89843686+11:14390:x1877639248856704:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1005us (8835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656712.139326:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1790656712.146158:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.146403:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248856832 00000100:00100000:1.0:1790656712.146416:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248856832 00000100:00100000:1.0:1790656712.146497:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1790656712.146509:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29780b47-b3ec-4efd-87cc-984c89843686+11:14390:x1877639248856832:12345-192.168.203.23@tcp:37:lfs.0 00000100:00100000:2.0:1790656712.151832:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29780b47-b3ec-4efd-87cc-984c89843686+11:14390:x1877639248856832:12345-192.168.203.23@tcp:37:lfs.0 Request processed in 5307us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656712.151856:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1790656712.156490:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.157857:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857088 00000100:00100000:3.0:1790656712.157876:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857088 00000100:00100000:2.0:1790656712.158349:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1790656712.158364:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928789c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29780b47-b3ec-4efd-87cc-984c89843686+11:14390:x1877639248857088:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656712.158734:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928789c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29780b47-b3ec-4efd-87cc-984c89843686+12:14390:x1877639248857088:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 371us (2256us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790656712.158743:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1790656712.228717:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.228958:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857216 00000100:00100000:2.0:1790656712.228971:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857216 00000100:00100000:2.0:1790656712.229049:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1790656712.229061:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+10:14396:x1877639248857216:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1790656712.229107:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656712.229134:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ec028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bd0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229219:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229237:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229251:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229267:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229273:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229280:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229394:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066ec03d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229404:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066ec03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229411:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066ec03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656712.229441:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790656712.229461:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790656712.229510:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066ec03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229523:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229530:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229537:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229543:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928480400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656712.229547:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229555:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229568:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:2.0:1790656712.229572:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656712.229577:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.229583:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231303:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231325:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231360:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231366:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656712.231372:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231380:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231399:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943909b4a900) 00010000:00010000:2.0:1790656712.231403:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656712.231408:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231414:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231490:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480600/0x9c3a6e82066ec028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd0 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231507:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480c00/0x9c3a6e82066ec03d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd0 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.231514:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:2.0:1790656712.231516:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790656712.231519:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480c00, rc 0) 00000100:00100000:0.0:1790656712.232059:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+11:14396:x1877639248857216:12345-192.168.203.23@tcp:101:bash.0 Request processed in 2992us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656712.232070:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1790656712.241345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.241467:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857472 00000100:00100000:1.0:1790656712.241480:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857472 00000100:00100000:1.0:1790656712.241561:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1790656712.241574:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+11:14396:x1877639248857472:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656712.241664:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656712.241692:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec044 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bd7 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.241860:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.241880:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.241911:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.241955:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.241971:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 11 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656712.241989:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269814784:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656712.242105:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9439121f4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656712.246730:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269814784:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656712.246796:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656712.247721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.248008:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857600 00000100:00100000:3.0:1790656712.248019:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857600 00010000:00010000:3.0:1790656712.248069:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 12 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656712.248117:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1790656712.248129:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29780b47-b3ec-4efd-87cc-984c89843686+12:2341:x1877639248857600:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656712.248148:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656712.248156:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 12 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248170:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 12 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248197:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec021 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bc9 expref: 12 pid: 14313 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248216:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:3.0:1790656712.248222:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248258:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248266:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.248294:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656712.248366:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29780b47-b3ec-4efd-87cc-984c89843686+11:2341:x1877639248857600:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 239us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.248374:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00010000:00010000:1.0:1790656712.249015:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.249032:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.249061:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.249073:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.249083:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251000:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251038:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251052:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656712.251067:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790656712.251101:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251108:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251116:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251122:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900030800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656712.251127:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251134:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251147:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:1.0:1790656712.251150:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656712.251156:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251163:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec04b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790656712.251179:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004049738e reply state 00000000e039e860 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656712.251194:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790656712.251241:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec044 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251260:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.251268:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:1.0:1790656712.251270:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790656712.251272:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031c00, rc 0) 00000100:00100000:1.0:1790656712.251346:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14396:x1877639248857472:12345-192.168.203.23@tcp:101:bash.0 Request processed in 9774us (10020us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790656712.251357:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00010000:00010000:1.0:1790656712.257391:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257415:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257424:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257431:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656712.257437:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257454:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257500:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9439148d8b00) 00010000:00010000:1.0:1790656712.257503:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656712.257509:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.257516:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec052 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656712.277846:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.277985:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857728 00000100:00100000:1.0:1790656712.278000:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857728 00000100:00100000:1.0:1790656712.278074:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:1.0:1790656712.278086:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+13:14396:x1877639248857728:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1790656712.278118:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656712.278147:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec067 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bde expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278235:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278252:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278266:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656712.278314:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790656712.278320:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656712.278344:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278380:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278411:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec067 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 15 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278436:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 14 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.278456:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:1.0:1790656712.278459:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656712.278464:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030800, rc 0) 00000100:00100000:1.0:1790656712.278547:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+14:14396:x1877639248857728:12345-192.168.203.23@tcp:101:bash.0 Request processed in 463us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656712.278555:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1790656712.283688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.284815:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248857984 00000100:00100000:3.0:1790656712.284834:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248857984 00000100:00100000:3.0:1790656712.284964:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656712.284978:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14396:x1877639248857984:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1790656712.285482:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+15:14396:x1877639248857984:12345-192.168.203.23@tcp:35:bash.0 Request processed in 504us (1805us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790656712.285491:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656712.366295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.366738:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248858240 00000100:00100000:1.0:1790656712.366761:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248858240 00000100:00100000:1.0:1790656712.366843:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1790656712.366856:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+15:14406:x1877639248858240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1790656712.366888:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656712.366913:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237be5 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656712.368506:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790656712.368743:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec075 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237be5 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.368787:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943907fdc500) 00010000:00010000:1.0:1790656712.368791:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656712.368799:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237be5 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.368819:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031a00, rc 0) 00000100:00100000:1.0:1790656712.368923:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+16:14406:x1877639248858240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2069us (2641us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790656712.368933:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1790656712.376055:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.376190:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248858496 00000100:00100000:2.0:1790656712.376203:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248858496 00000100:00100000:2.0:1790656712.376281:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1790656712.376294:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+16:14406:x1877639248858496:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1790656712.376942:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+17:14406:x1877639248858496:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 647us (899us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790656712.376952:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1790656712.418432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.419480:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248858752 00000100:00100000:3.0:1790656712.419496:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248858752 00000100:00100000:3.0:1790656712.419605:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:3.0:1790656712.419618:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+17:14409:x1877639248858752:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1790656712.419653:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656712.419682:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec083 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bec expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.419822:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066ec08a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.419858:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066ec08a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.419872:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066ec08a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790656712.419889:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790656712.420393:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec083 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bec expref: 20 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.420419:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066ec08a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bec expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.420430:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:3.0:1790656712.420433:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790656712.420437:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c97c00, rc 0) 00000100:00100000:3.0:1790656712.420537:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+19:14409:x1877639248858752:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 921us (2120us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790656712.420545:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:3.0:1790656712.423677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.423732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.424072:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248859008 00000100:00100000:1.0:1790656712.424086:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248859008 00000100:00100000:1.0:1790656712.424184:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:1.0:1790656712.424197:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+19:14409:x1877639248859008:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1790656712.424292:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424325:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424340:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424374:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424383:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424417:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424424:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656712.424429:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424439:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424465:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:1.0:1790656712.424469:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790656712.424475:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.424482:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec098 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656712.424587:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+19:14409:x1877639248859008:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 393us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656712.424634:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1790656712.425226:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248858880 00000100:00100000:0.0:1790656712.425238:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248858880 00000100:00100000:0.0:1790656712.425306:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656712.425317:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+19:2339:x1877639248858880:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790656712.425334:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656712.425358:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c97c00/0x9c3a6e82066ec08a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bec expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.425376:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656712.425381:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790656712.425415:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+18:2339:x1877639248858880:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 101us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656712.425423:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656712.429164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.429274:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248859264 00000100:00100000:3.0:1790656712.429289:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248859264 00000100:00100000:3.0:1790656712.429364:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1790656712.429377:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+18:14409:x1877639248859264:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1790656712.429709:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+19:14409:x1877639248859264:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 334us (559us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1790656712.429810:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00010000:00010000:0.0:1790656712.544745:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656712.708423:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.708580:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248859520 00000100:00100000:0.0:1790656712.708820:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248859520 00000100:00100000:0.0:1790656712.709163:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1790656712.709178:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+19:14440:x1877639248859520:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:0.0:1790656712.709211:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656712.709238:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355600/0x9c3a6e82066ec09f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bf3 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.709525:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec0a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.709561:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.709635:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656712.709654:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790656712.709838:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355600/0x9c3a6e82066ec09f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bf3 expref: 22 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.709859:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bf3 expref: 21 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656712.709868:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656712.709871:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790656712.709874:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354200, rc 0) 00000100:00100000:0.0:1790656712.709956:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+21:14440:x1877639248859520:12345-192.168.203.23@tcp:101:cat.0 Request processed in 781us (1547us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790656712.709965:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1790656712.717550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.717639:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.717749:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248859648 00000100:00100000:2.0:1790656712.717773:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248859648 00000100:00100000:2.0:1790656712.717869:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1790656712.717881:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e04176dd-0835-45f2-9651-67d83fe9deba+21:2339:x1877639248859648:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656712.717903:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656712.718175:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec0a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bf3 expref: 21 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.718201:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656712.718207:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656712.718284:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e04176dd-0835-45f2-9651-67d83fe9deba+20:2339:x1877639248859648:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 406us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656712.718292:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656712.718782:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248859904 00000100:00100000:3.0:1790656712.718797:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248859904 00000100:00100000:3.0:1790656712.718883:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1790656712.718895:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+20:14440:x1877639248859904:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:3.0:1790656712.719249:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+21:14440:x1877639248859904:12345-192.168.203.23@tcp:35:cat.0 Request processed in 355us (1712us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790656712.719257:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1790656712.786268:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.786403:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248860160 00000100:00100000:2.0:1790656712.786417:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248860160 00000100:00100000:2.0:1790656712.786499:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1790656712.786511:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+21:14446:x1877639248860160:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1790656712.786567:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656712.786662:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237bfa expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786799:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786818:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786828:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 22 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786838:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786880:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 22 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.786897:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 22 pid: 14315 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656712.786911:0:14315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269814912:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656712.787035:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.787046:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 22 pid: 14314 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656712.787070:0:14315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269815040:192.168.203.23@tcp:104: 00000100:00100000:2.0:1790656712.787099:0:14315:0:(client.c:2716:ptlrpc_set_wait()) set ffff943908357300 going to sleep for 11 seconds 00000100:00100000:0.0:1790656712.793909:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656712.793954:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.794077:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248860288 00000100:00100000:3.0:1790656712.794089:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248860288 00010000:00010000:3.0:1790656712.794141:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 23 pid: 14315 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656712.794183:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248860416 00000100:00100000:3.0:1790656712.794186:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248860416 00010000:00010000:3.0:1790656712.794203:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 24 pid: 14314 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656712.794220:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656712.794231:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+24:2340:x1877639248860288:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656712.794252:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656712.794259:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 24 pid: 14315 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794274:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 24 pid: 14315 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794322:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:3.0:1790656712.794328:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794338:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794345:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656712.794402:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+24:2340:x1877639248860288:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 173us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.794410:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1790656712.794480:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1790656712.794488:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+23:2340:x1877639248860416:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656712.794496:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656712.794502:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 23 pid: 14314 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794512:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 23 pid: 14314 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794522:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:3.0:1790656712.794528:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794537:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794556:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.794577:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656712.794642:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+23:2340:x1877639248860416:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 154us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.794649:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00010000:00010000:2.0:1790656712.794875:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030800/0x9c3a6e82066ec06e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bde expref: 22 pid: 14315 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656712.794897:0:14315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269814912:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656712.794908:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031c00/0x9c3a6e82066ec059 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bd7 expref: 21 pid: 14314 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656712.794916:0:14315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1877639269815040:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656712.794938:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.794947:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.794952:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790656712.794985:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790656712.795204:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bfa expref: 22 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.795222:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481600/0x9c3a6e82066ec0bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237bfa expref: 21 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.795242:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656712.795246:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790656712.795249:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481600, rc 0) 00000100:00100000:2.0:1790656712.795288:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+21:14446:x1877639248860160:12345-192.168.203.23@tcp:101:dd.0 Request processed in 8779us (9035us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790656712.795296:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000040:00080000:0.0:1790656712.800381:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790656712.801480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.804126:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248860672 00000100:00100000:3.0:1790656712.804150:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248860672 00000100:00100000:3.0:1790656712.808076:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1790656712.808117:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+21:14446:x1877639248860672:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:3.0:1790656712.810147:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.810179:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.810196:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790656712.810714:0:14313:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790656712.810780:0:14313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c218676 reply state 000000000f4d9434 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656712.810804:0:14313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790656712.810970:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+24:14446:x1877639248860672:12345-192.168.203.23@tcp:36:dd.0 Request processed in 2870us (9496us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790656712.810989:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000020:00080000:3.0:1790656712.810997:0:14313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790656712.815545:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815568:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815577:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815584:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1790656712.815634:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815644:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815666:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656712.815670:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790656712.815676:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.815682:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943907c96200/0x9c3a6e82066ec0c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656712.816517:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.816658:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248860800 00000100:00100000:2.0:1790656712.816672:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248860800 00000100:00100000:2.0:1790656712.816844:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1790656712.816857:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+23:14446:x1877639248860800:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1790656712.816890:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656712.816914:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c01 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.817000:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c01 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.817017:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c01 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.817040:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656712.817043:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656712.817047:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928480400, rc 0) 00000100:00100000:2.0:1790656712.817120:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+24:14446:x1877639248860800:12345-192.168.203.23@tcp:101:dd.0 Request processed in 265us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656712.817129:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1790656712.829056:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656712.829265:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861056 00000100:00100000:3.0:1790656712.829279:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861056 00000100:00100000:3.0:1790656712.829395:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656712.829407:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+24:14446:x1877639248861056:12345-192.168.203.23@tcp:103:dd.0 00010000:00010000:3.0:1790656712.829430:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656712.829471:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928480400/0x9c3a6e82066ec0d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c01 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656712.829495:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:3.0:1790656712.829501:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656712.829584:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9439280c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+23:14446:x1877639248861056:12345-192.168.203.23@tcp:103:dd.0 Request processed in 178us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656712.829712:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1790656712.831852:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656712.832128:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861184 00000100:00100000:1.0:1790656712.832140:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861184 00000100:00100000:1.0:1790656712.832212:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1790656712.832225:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+23:14446:x1877639248861184:12345-192.168.203.23@tcp:58:dd.0 00010000:00010000:1.0:1790656712.832386:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.832408:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656712.832430:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790656712.833427:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790656712.834196:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790656712.834299:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790656712.834511:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+23:14446:x1877639248861184:12345-192.168.203.23@tcp:58:dd.0 Request processed in 2280us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656712.834525:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1790656712.837221:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656712.837345:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861312 00000100:00100000:2.0:1790656712.837358:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861312 00000100:00100000:2.0:1790656712.837457:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1790656712.837469:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+23:14446:x1877639248861312:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1790656712.837494:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790656712.837519:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c08 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837617:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837719:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837750:0:14315:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837765:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837781:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:2.0:1790656712.837785:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790656712.837789:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656712.837797:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943928481800, rc 0) 00000100:00100000:2.0:1790656712.837905:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+24:14446:x1877639248861312:12345-192.168.203.23@tcp:101:dd.0 Request processed in 430us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656712.837912:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000001:00080000:0.0:1790656712.926269:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1790656712.926291:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1790656712.926583:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1790656712.926723:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1790656712.926963:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00010000:00010000:3.0:1790656713.567376:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790656713.823037:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790656713.823049:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790656713.823099:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790656713.823106:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790656713.823310:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1877639269815168:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790656713.823465:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff94391f620780 going to sleep for 11 seconds 00000100:00100000:2.0:1790656713.834034:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1877639269815168:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790656713.835414:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656713.835869:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861440 00000100:00100000:0.0:1790656713.835884:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861440 00000100:00100000:0.0:1790656713.835954:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656713.835966:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861440:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790656713.836068:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861440:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 104us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.836076:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1790656713.850817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656713.851053:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861568 00000100:00100000:1.0:1790656713.851067:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861568 00000100:00100000:1.0:1790656713.851151:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1790656713.851164:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861568:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790656713.851216:0:14313:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790656713.851362:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861568:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 201us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656713.851371:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1790656713.857842:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656713.858508:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861696 00000100:00100000:0.0:1790656713.858523:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861696 00000100:00100000:0.0:1790656713.858645:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:0.0:1790656713.858659:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861696:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790656713.858886:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.858908:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.858940:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862905:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862930:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862945:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862980:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862990:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.862997:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656713.863041:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790656713.863046:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790656713.863065:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863077:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863084:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863109:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863116:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656713.863120:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863129:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.863142:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943909b4aa00) 00010000:00010000:0.0:1790656713.864095:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656713.864104:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864113:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec0e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864133:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864139:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864145:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864151:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802355200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656713.864154:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864173:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864184:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff943910d36100) 00010000:00010000:0.0:1790656713.864187:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656713.864190:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864196:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355200/0x9c3a6e82066ec0ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864211:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864217:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864223:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864229:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802355400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656713.864232:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864237:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864244:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656713.864246:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656713.864249:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.864267:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355400/0x9c3a6e82066ec0f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656713.864373:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861696:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 5713us (6541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.864385:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1790656713.867314:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656713.867408:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248861952 00000100:00100000:0.0:1790656713.867417:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248861952 00000100:00100000:0.0:1790656713.867486:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1790656713.867496:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+11:14448:x1877639248861952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656713.867515:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656713.867532:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ec0fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c0f expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867654:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867669:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867681:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790656713.867692:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790656713.867820:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867828:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867851:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867859:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656713.867863:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867871:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867883:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656713.867886:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790656713.867890:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867896:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354400/0x9c3a6e82066ec101 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867936:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ec0fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c0f expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867946:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943909b4aa00) 00010000:00010000:0.0:1790656713.867948:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790656713.867952:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802355000/0x9c3a6e82066ec0fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c0f expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656713.867962:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802355000, rc 0) 00000100:00100000:0.0:1790656713.868015:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+12:14448:x1877639248861952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 520us (711us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790656713.868033:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1790656713.873189:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656713.873274:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248862080 00000100:00100000:0.0:1790656713.873290:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248862080 00000100:00100000:0.0:1790656713.873360:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1790656713.873371:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+12:14448:x1877639248862080:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790656713.873416:0:14315:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790656713.873539:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+12:14448:x1877639248862080:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.873547:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1790656713.877278:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656713.877375:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248862336 00000100:00100000:1.0:1790656713.877392:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248862336 00000100:00100000:1.0:1790656713.877489:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1790656713.877503:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+12:14448:x1877639248862336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656713.877533:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656713.877560:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec10f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c16 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790656713.879635:0:14314:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1790656713.879648:0:14314:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1790656713.879705:0:14314:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1790656713.881954:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec116 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.881978:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.881993:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.882080:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec10f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c16 expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.882102:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec116 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c16 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.882110:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8a00) 00010000:00010000:1.0:1790656713.882113:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790656713.882117:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030400, rc 0) 00000100:00100000:1.0:1790656713.882205:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248862336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4705us (4936us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1790656713.882215:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1790656713.887944:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269815680:0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.887944:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269815424:0@lo:400:kworker.0 00000100:00100000:2.0:1790656713.888133:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269815296:0@lo:400:kworker.0 00000100:00100000:3.0:1790656713.889088:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656713.891561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656713.891659:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269815936:0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.891819:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815424 00000100:00100000:0.0:1790656713.891829:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815424 00000100:00100000:0.0:1790656713.891910:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790656713.891923:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269815424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656713.891987:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269815552:0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.891995:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1877639269815424:12345-0@lo:400:kworker.0 Request processed in 74us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.892005:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790656713.892030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790656713.892036:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656713.892087:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815552 00000100:00100000:3.0:1790656713.892092:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815552 00000100:00100000:3.0:1790656713.892132:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656713.892139:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269815552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790656713.892176:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269815552:12345-0@lo:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656713.892183:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790656713.892225:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269815552:0@lo:400:kworker.0 00000100:00100000:3.0:1790656713.892276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790656713.894546:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790656713.895986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656713.896058:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269815808:0@lo:400:kworker.0 00000100:00100000:2.0:1790656713.896113:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269816064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790656713.896141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656713.898215:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815296 00000100:00100000:0.0:1790656713.898236:0:14308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815296 00000100:00100000:0.0:1790656713.898309:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790656713.898320:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3302:x1877639269815296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.898470:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff+19:3302:x1877639269815296:12345-0@lo:400:kworker.0 Request processed in 151us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.898477:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790656713.900966:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1877639269815424:0@lo:400:kworker.0 00000100:00100000:3.0:1790656713.901102:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656713.904924:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269816064 00000100:00100000:0.0:1790656713.904939:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269816064 00000100:00100000:0.0:1790656713.905006:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790656713.905016:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269816064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790656713.905052:0:15001:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790656713.905143:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877639269816064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (9001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.905150:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790656713.909118:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815680 00000100:00100000:1.0:1790656713.909142:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815680 00000100:00100000:1.0:1790656713.909256:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815936 00000100:00100000:1.0:1790656713.909262:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815936 00000100:00100000:0.0:1790656713.909277:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1877639269816064:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790656713.909316:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656713.909345:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790656713.909358:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269815680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656713.909481:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877639269815680:12345-0@lo:400:kworker.0 Request processed in 126us (20398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656713.909489:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790656713.909525:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790656713.909530:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269815936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656713.909567:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877639269815936:12345-0@lo:400:kworker.0 Request processed in 37us (17290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656713.909573:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790656713.909668:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1877639269815936:0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.909934:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877639269815680:0@lo:400:kworker.0 00000100:00100000:0.0:1790656713.910732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656713.910825:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c05058d9-4e17-4bd7-bcb7-bf10861cf2ff:3302:1877639269815296:0@lo:400:kworker.0 00000100:00100000:1.0:1790656713.910828:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248862592 00000100:00100000:1.0:1790656713.910840:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248862592 00000100:00100000:1.0:1790656713.910877:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269815808 00000100:00100000:1.0:1790656713.910881:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269815808 00000100:00100000:1.0:1790656713.910920:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790656713.910927:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269815808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790656713.911002:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877639269815808:12345-0@lo:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656713.911010:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790656713.911028:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:1.0:1790656713.911034:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248862592:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790656713.911093:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656713.911133:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec116 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c16 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656713.911151:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1877639269815808:0@lo:400:kworker.0 00010000:00010000:1.0:1790656713.911182:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8a00) 00010000:00010000:1.0:1790656713.911325:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790656713.911356:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911373:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911383:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911399:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911407:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911414:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.911705:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914467:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914480:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914487:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656713.914493:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914528:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914549:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943910d36e00) 00010000:00010000:1.0:1790656713.914553:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656713.914559:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914566:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec124 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914608:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914615:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914621:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914628:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656713.914630:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914637:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914645:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb3b627c7 (ffff9439148d8b00) 00010000:00010000:1.0:1790656713.914647:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790656713.914651:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.914668:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec12b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb3b627c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790656713.915070:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790656713.915640:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+13:14448:x1877639248862592:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 4557us (14493us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790656713.915652:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1790656713.932697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656713.936533:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248862720 00000100:00100000:2.0:1790656713.938456:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248862720 00000100:00100000:1.0:1790656713.945312:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1790656713.945335:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+13:14448:x1877639248862720:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656713.945365:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656713.945400:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec132 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c1d expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945465:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945482:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945496:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945654:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec132 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c1d expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945679:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031000/0x9c3a6e82066ec139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c1d expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.945701:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:1.0:1790656713.945704:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790656713.945709:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031000, rc 0) 00000100:00100000:0.0:1790656713.950759:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248862720:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 5416us (18061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656713.950776:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1790656713.973421:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656713.973549:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248862976 00000100:00100000:1.0:1790656713.973563:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248862976 00000100:00100000:2.0:1790656713.975696:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1790656713.975726:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248862976:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790656713.975842:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656713.975864:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656713.975878:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790656713.976898:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790656713.976916:0:14315:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429113323846ns, next at 430113320910ns, rc = 0 00000004:00010000:2.0:1790656713.977031:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000305ef2ef reply state 000000001c92e47d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656713.977044:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790656713.979751:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+16:14448:x1877639248862976:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 4021us (6607us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790656713.979766:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00010000:00010000:1.0:1790656713.985392:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985416:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985425:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985432:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1790656713.985447:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985456:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985480:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:1.0:1790656713.985483:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790656713.985489:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.985497:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481a00/0x9c3a6e82066ec140 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656713.988482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656713.991657:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248863104 00000100:00100000:1.0:1790656713.991706:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248863104 00000100:00100000:1.0:1790656713.991795:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1790656713.991807:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+15:14448:x1877639248863104:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656713.991840:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656713.991867:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c24 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.991947:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.991966:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656713.992316:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:1.0:1790656713.992321:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790656713.992326:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900031800, rc 0) 00000100:00100000:1.0:1790656713.992470:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+16:14448:x1877639248863104:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 664us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656713.992479:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1790656714.005319:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.008108:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248863232 00000100:00100000:0.0:1790656714.008130:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248863232 00000100:00100000:0.0:1790656714.008542:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1790656714.008563:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2341:x1877639248863232:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790656714.009109:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+6:2341:x1877639248863232:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 553us (3963us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790656714.009119:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00080000:1.0:1790656714.011228:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790656714.016475:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656714.020178:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248863488 00000100:00100000:2.0:1790656714.020276:0:14317:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248863488 00000100:00100000:2.0:1790656714.021225:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1790656714.021248:0:14317:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+16:14448:x1877639248863488:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790656714.021637:0:14317:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393bfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e04176dd-0835-45f2-9651-67d83fe9deba+17:14448:x1877639248863488:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 398us (5176us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790656714.021646:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:1.0:1790656714.022828:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790656714.028751:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.028921:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248863744 00000100:00100000:0.0:1790656714.028934:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248863744 00000100:00100000:0.0:1790656714.029018:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1790656714.029031:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+17:14448:x1877639248863744:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790656714.029180:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+17:14448:x1877639248863744:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 152us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656714.029305:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1790656714.043852:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.043950:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248863872 00000100:00100000:1.0:1790656714.043964:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248863872 00000100:00100000:1.0:1790656714.044072:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1790656714.044085:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+17:14448:x1877639248863872:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790656714.044114:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790656714.044142:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec14e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c2b expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044279:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044298:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044312:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790656714.044360:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790656714.044385:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044417:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030400/0x9c3a6e82066ec14e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c2b expref: 19 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044453:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c2b expref: 18 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.044463:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:1.0:1790656714.044466:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790656714.044470:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943900030200, rc 0) 00000100:00100000:1.0:1790656714.044550:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248863872:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 468us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656714.044557:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1790656714.052517:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.052647:0:15726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864000 00000100:00100000:3.0:1790656714.052660:0:15726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864000 00000100:00100000:3.0:1790656714.052744:0:15726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1790656714.052756:0:15726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e04176dd-0835-45f2-9651-67d83fe9deba+6:2342:x1877639248864000:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790656714.052781:0:15726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790656714.052811:0:15726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c32 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656714.052844:0:15726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abb40c9, blocks: 0x1 00010000:00010000:3.0:1790656714.052869:0:15726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1790656714.052875:0:15726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.052886:0:15726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 7 pid: 15726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.052908:0:15726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 7 pid: 15726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.052923:0:15726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943907c96c00, rc 0) 00000100:00100000:3.0:1790656714.053005:0:15726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e04176dd-0835-45f2-9651-67d83fe9deba+7:2342:x1877639248864000:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 251us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656714.053030:0:15726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1790656714.059124:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.059241:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864256 00000100:00100000:3.0:1790656714.059257:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864256 00000100:00100000:3.0:1790656714.059337:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1790656714.059351:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248864256:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790656714.059520:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248864256:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 171us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656714.059528:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:0.0:1790656714.062849:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.062952:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864384 00000100:00100000:1.0:1790656714.062967:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864384 00000100:00100000:1.0:1790656714.063064:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1790656714.063077:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248864384:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790656714.169855:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:3.0:1790656714.169880:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1790656714.169889:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1790656714.169899:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1790656714.170843:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248864384:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 107228us (107470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790656714.170857:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1790656714.171061:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269816192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790656714.171124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656714.172004:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269816192 00000100:00100000:0.0:1790656714.172015:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269816192 00000100:00100000:0.0:1790656714.172298:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790656714.172321:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877639269816192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790656714.172548:0:14999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790656714.172552:0:14999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790656714.172555:0:14999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790656714.172557:0:14999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790656713 -> 1790656713 00002000:00010000:0.0:1790656714.172560:0:14999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790656714.172682:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877639269816192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 374us (1558us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790656714.172689:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1790656714.172784:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94391f5a1f80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1790656714.172792:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94391f5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1877639269816192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790656714.176102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656714.185021:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864512 00000100:00100000:2.0:1790656714.185042:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864512 00000100:00100000:2.0:1790656714.185147:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1790656714.185159:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+7:2341:x1877639248864512:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790656714.185341:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+7:2341:x1877639248864512:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 183us (9253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656714.185349:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1790656714.196874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.200855:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864768 00000100:00100000:0.0:1790656714.200879:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864768 00000100:00100000:0.0:1790656714.200999:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:0.0:1790656714.201012:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248864768:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790656714.201087:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790656714.201123:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900030200/0x9c3a6e82066ec155 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c2b expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.201153:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:0.0:1790656714.201159:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790656714.201195:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.201211:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.201223:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790656714.201493:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ec65524 reply state 0000000046bc2d77 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.201505:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790656714.203720:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+15:14448:x1877639248864768:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2693us (6843us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790656714.203735:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00010000:00010000:0.0:1790656714.213571:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.213614:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.213647:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.214381:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656714.214389:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.214401:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.214425:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:0.0:1790656714.214428:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656714.214460:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.214470:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354e00/0x9c3a6e82066ec163 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656714.214934:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.215225:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248864896 00000100:00100000:0.0:1790656714.215239:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248864896 00000100:00100000:0.0:1790656714.215480:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1790656714.215494:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+7:14448:x1877639248864896:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790656714.215518:0:14998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790656714.215546:0:14998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xffa854f78a237c39 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.215586:0:14998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.215661:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656714.215667:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656714.215674:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.215723:0:14998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.215740:0:14998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.215758:0:14998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14998:1877639269816320:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656714.215870:0:14998:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656714.225476:0:14998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14998:1877639269816320:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656714.225530:0:14998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.225557:0:14998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943802354800, rc 0) 00000100:00100000:0.0:1790656714.226091:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+8:14448:x1877639248864896:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 10597us (11161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656714.226102:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1790656714.243991:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.244142:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865024 00000100:00100000:1.0:1790656714.244157:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865024 00010000:00010000:1.0:1790656714.244211:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656714.244265:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1790656714.244278:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e04176dd-0835-45f2-9651-67d83fe9deba+8:2341:x1877639248865024:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790656714.244297:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790656714.244339:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.244358:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.244387:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82fdc40/0x9c3a6e82066ec15c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c32 expref: 8 pid: 15726 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.244409:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656714.244414:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656714.244452:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 7 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.244465:0:14298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 7 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.244516:0:14298:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 7 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656714.244534:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14298:1877639269816448:192.168.203.23@tcp:105: 00000100:00100000:2.0:1790656714.246861:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392861fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656714.260543:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.260670:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865152 00000100:00100000:1.0:1790656714.260683:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865152 00000100:00100000:1.0:1790656714.260748:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1790656714.260761:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e04176dd-0835-45f2-9651-67d83fe9deba+8:2341:x1877639248865152:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790656714.261044:0:14999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790656714.261049:0:14999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790656712 00002000:00010000:1.0:1790656714.261052:0:14999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790656711 00002000:00010000:1.0:1790656714.261055:0:14999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790656713 -> 1790656712 00002000:00010000:1.0:1790656714.261057:0:14999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790656714.261138:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e04176dd-0835-45f2-9651-67d83fe9deba+9:2341:x1877639248865152:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 379us (611us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790656714.261148:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1790656714.261662:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14298:1877639269816448:192.168.203.23@tcp:105: 00010000:00010000:3.0:1790656714.261691:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656714.261737:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e04176dd-0835-45f2-9651-67d83fe9deba+8:2341:x1877639248865024:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 17460us (17761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656714.261747:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1790656714.264758:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.264974:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865280 00000100:00100000:1.0:1790656714.264987:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865280 00000100:00100000:1.0:1790656714.265053:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1790656714.265064:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+8:2342:x1877639248865280:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790656714.265143:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.265170:0:14996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.265181:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790656714.265186:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790656714.265192:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.265235:0:14996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790656714.265252:0:14996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 8 pid: 14998 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656714.265268:0:14996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14996:1877639269816576:192.168.203.23@tcp:104: 00000100:00100000:1.0:1790656714.265377:0:14996:0:(client.c:2716:ptlrpc_set_wait()) set ffff94392861f240 going to sleep for 11 seconds 00000100:00100000:2.0:1790656714.271351:0:14996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935b3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14996:1877639269816576:192.168.203.23@tcp:104: 00010000:00010000:2.0:1790656714.271394:0:14996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656714.288161:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.288272:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865408 00000100:00100000:3.0:1790656714.288285:0:14299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865408 00010000:00010000:3.0:1790656714.288350:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 9 pid: 14998 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656714.288420:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1790656714.288440:0:14299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94391f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+9:2342:x1877639248865408:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790656714.288462:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790656714.288493:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 9 pid: 14998 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.288509:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 9 pid: 14998 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.288539:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2f29be/0x9c3a6e82066ec16a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c39 expref: 9 pid: 14998 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.288559:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656714.288564:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790656714.288571:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.288582:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.288797:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790656714.288860:0:14299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e04176dd-0835-45f2-9651-67d83fe9deba+8:2342:x1877639248865408:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 430us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790656714.288869:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:2.0:1790656714.289099:0:14996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289120:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289151:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289160:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289168:0:14996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289175:0:14996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031400 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656714.289180:0:14996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289190:0:14996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289207:0:14996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.289215:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cb8686/0x9c3a6e82066ec171 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656714.289282:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94391f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e04176dd-0835-45f2-9651-67d83fe9deba+7:2342:x1877639248865280:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 24219us (24537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656714.289291:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1790656714.292409:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.292548:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865664 00000100:00100000:0.0:1790656714.292563:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865664 00000100:00100000:0.0:1790656714.292701:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1790656714.292714:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+14:14448:x1877639248865664:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790656714.292828:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.292851:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.292865:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.293177:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.293190:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.293200:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.293243:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.293261:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 15 pid: 14314 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.293277:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269816704:192.168.203.23@tcp:104: 00000100:00100000:0.0:1790656714.293390:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff943801e0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790656714.300065:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656714.300173:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248865792 00000100:00100000:2.0:1790656714.300186:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248865792 00010000:00010000:2.0:1790656714.300240:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 16 pid: 14314 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656714.300292:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1790656714.300304:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e04176dd-0835-45f2-9651-67d83fe9deba+16:2341:x1877639248865792:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790656714.300332:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790656714.300340:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 16 pid: 14314 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.300355:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 16 pid: 14314 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.300384:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:2.0:1790656714.300390:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.300401:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.300410:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.300459:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790656714.300530:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e04176dd-0835-45f2-9651-67d83fe9deba+16:2341:x1877639248865792:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 228us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656714.300538:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:0.0:1790656714.302245:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031800/0x9c3a6e82066ec147 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c24 expref: 15 pid: 14314 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.302303:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269816704:192.168.203.23@tcp:104: 00010000:00010000:0.0:1790656714.302353:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.302362:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.302367:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790656714.302872:0:14314:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790656714.303053:0:14314:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790656714.303103:0:14314:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790656714.303215:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14314:1877639269816832:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790656714.305745:0:14314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656714.305807:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff943935148e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790656714.305897:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269816832 00000100:00100000:2.0:1790656714.305914:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269816832 00000100:00100000:2.0:1790656714.305988:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790656714.306001:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14314:x1877639269816832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790656714.306150:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14314:x1877639269816832:12345-0@lo:1000:mdt00_001.0 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656714.306159:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790656714.307819:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14314:1877639269816832:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790656714.309461:0:14314:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790656714.309554:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14314:1877639269816960:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790656714.310804:0:14314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790656714.310900:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff943911c5c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790656714.318482:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269816960 00000100:00100000:1.0:1790656714.318498:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269816960 00000100:00100000:1.0:1790656714.318551:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790656714.318561:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1877639269816960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790656714.319118:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14314:x1877639269816960:12345-0@lo:1000:mdt00_001.0 Request processed in 556us (8316us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790656714.319137:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790656714.321505:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14314:1877639269816960:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790656714.321553:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.321565:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.321587:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.321620:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656714.321625:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.321964:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.321983:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:0.0:1790656714.321987:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790656714.321993:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322000:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354200/0x9c3a6e82066ec17f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322035:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322042:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322048:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322053:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943900031a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656714.322056:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322076:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322085:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656714.322087:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790656714.322095:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322106:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322116:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.322177:0:14314:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff943928481800/0x9c3a6e82066ec0de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xffa854f78a237c08 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.322191:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94393f9e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269817088:192.168.203.23@tcp:105: 00000100:00100000:0.0:1790656714.322513:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff943911c5ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790656714.329925:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94393f9e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1877639269817088:192.168.203.23@tcp:105: 00010000:00010000:0.0:1790656714.329963:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.329975:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943900031a00/0x9c3a6e82066ec0d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330007:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330033:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330044:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330055:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330061:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330068:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330074:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656714.330077:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330084:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330094:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656714.330097:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790656714.330101:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330107:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354600/0x9c3a6e82066ec186 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330116:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330128:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330134:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330139:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1790656714.330142:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330148:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330156:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9439148d8200) 00010000:00010000:0.0:1790656714.330159:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790656714.330162:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.330168:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943802354a00/0x9c3a6e82066ec178 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656714.330455:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248865664:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 37743us (38058us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790656714.330466:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000020:00080000:0.0:1790656714.330473:0:14314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790656714.331165:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790656714.331171:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790656714.331219:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790656714.331225:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790656714.333798:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1790656714.333867:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866048 00000100:00100000:2.0:1790656714.333877:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866048 00000100:00100000:2.0:1790656714.334025:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1790656714.334035:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943928788050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+18:14448:x1877639248866048:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790656714.334540:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000004:00080000:2.0:1790656714.335026:0:14316:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790656714.335119:0:14316:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790656714.335159:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335175:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335198:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335206:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335212:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335217:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656714.335239:0:14316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790656714.335326:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943928788050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+20:14448:x1877639248866048:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1289us (1533us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790656714.335335:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000020:00080000:2.0:1790656714.335340:0:14316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790656714.335426:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790656714.335442:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.335450:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943928481200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656714.335460:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.335468:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.335490:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9439148d8b00) 00010000:00010000:0.0:1790656714.335493:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790656714.335498:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.335504:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943928481200/0x9c3a6e82066ec18d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.335515:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656714.335517:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790656714.335519:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790656714.343835:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866176 00000100:00100000:2.0:1790656714.343847:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866176 00000100:00100000:2.0:1790656714.343958:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1790656714.343970:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+20:14446:x1877639248866176:12345-192.168.203.23@tcp:49:dd.0 00000100:00100000:2.0:1790656714.344141:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e04176dd-0835-45f2-9651-67d83fe9deba+20:14446:x1877639248866176:12345-192.168.203.23@tcp:49:dd.0 Request processed in 173us (9610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656714.344148:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1790656714.527051:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1790656714.527096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.527193:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866304 00000100:00100000:3.0:1790656714.527203:0:15003:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866304 00000100:00100000:3.0:1790656714.527265:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866432 00000100:00100000:3.0:1790656714.527268:0:15003:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866432 00000100:00100000:3.0:1790656714.527287:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1790656714.527296:0:15003:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e04176dd-0835-45f2-9651-67d83fe9deba+8:2341:x1877639248866304:12345-192.168.203.23@tcp:4:dd.0 00002000:00010000:3.0:1790656714.527342:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abb40c8, atime: 0x6abb40c7, ctime: 0x6abb40c8, blocks: 0x1 00010000:00010000:3.0:1790656714.527351:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.527367:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1790656714.527372:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.527379:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.527393:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790656714.528521:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1790656714.528715:0:15004:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790656714.528728:0:15004:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790656714.529969:0:15002:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790656714.529993:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866560 00000100:00100000:2.0:1790656714.530004:0:15002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866560 00000100:00100000:0.0:1790656714.531026:0:16543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1790656714.531048:0:16543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+10:2342:x1877639248866432:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1790656714.531104:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.531128:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656714.531134:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790656714.531142:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.531162:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656714.590898:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790656714.736929:0:16543:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1790656714.736942:0:16543:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790656712 -> 1790656713 00002000:00010000:3.0:1790656714.736946:0:16543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1790656714.736965:0:16543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.736982:0:16543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737021:0:16543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737030:0:16543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943802354a00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656714.737035:0:16543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737046:0:16543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737072:0:16543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737079:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003377fc6f/0x9c3a6e82066ec19b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656714.737211:0:16543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+14:2342:x1877639248866432:12345-192.168.203.23@tcp:4:dd.0 Request processed in 206163us (210106us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790656714.737222:0:16543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1790656714.737262:0:16543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656714.737277:0:16543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+13:2341:x1877639248866560:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656714.737328:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737343:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.737357:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.737364:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737377:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737544:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737554:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737561:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737567:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97c00 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656714.737571:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737578:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737645:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.737653:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb26bd7/0x9c3a6e82066ec194 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656714.737701:0:15003:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e04176dd-0835-45f2-9651-67d83fe9deba+13:2341:x1877639248866304:12345-192.168.203.23@tcp:4:dd.0 Request processed in 210405us (210660us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1790656714.737708:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000001:00080000:0.0:1790656714.739244:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1790656714.739267:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1790656714.739277:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1790656714.739287:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1790656714.739297:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000100:00100000:3.0:1790656714.756008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.756043:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.756065:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.756091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.756108:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656714.756382:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866688 00000100:00100000:3.0:1790656714.756396:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866688 00000100:00100000:3.0:1790656714.756485:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866944 00000100:00100000:3.0:1790656714.756488:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866944 00000100:00100000:3.0:1790656714.756503:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248866816 00000100:00100000:3.0:1790656714.756506:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248866816 00000100:00100000:3.0:1790656714.756522:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867072 00000100:00100000:3.0:1790656714.756525:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867072 00000100:00100000:3.0:1790656714.756535:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867200 00000100:00100000:3.0:1790656714.756538:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867200 00000100:00100000:3.0:1790656714.756555:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1790656714.756566:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+11:2340:x1877639248866688:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656714.756639:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.756661:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.756666:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.756674:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.756715:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656714.805196:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1790656714.811705:0:16543:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1790656714.811716:0:16543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1790656714.811730:0:16543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811743:0:16543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811751:0:16543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811759:0:16543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97000 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656714.811763:0:16543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811772:0:16543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811792:0:16543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.811799:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97f2440/0x9c3a6e82066ec1a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656714.811910:0:16543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+13:2341:x1877639248866560:12345-192.168.203.23@tcp:4:dd.0 Request processed in 74621us (283385us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1790656714.811921:0:16543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1790656714.811956:0:16543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1790656714.811967:0:16543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+12:2340:x1877639248866944:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656714.811999:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.812012:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.812016:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.812022:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.812034:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656714.880232:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1790656714.880377:0:15004:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:3.0:1790656714.880393:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880421:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880439:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880468:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656714.880473:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880482:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880504:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.880511:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656714.880855:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+12:2340:x1877639248866688:12345-192.168.203.23@tcp:4:dd.0 Request processed in 124285us (124858us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790656714.880866:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1790656714.884122:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656714.884138:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+11:2340:x1877639248866816:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656714.884178:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.884195:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790656714.884199:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.884205:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.884233:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790656714.945648:0:16543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1790656714.945668:0:16543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945680:0:16543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945689:0:16543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945696:0:16543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656714.945701:0:16543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945711:0:16543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945731:0:16543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945740:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790656714.945754:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000100:00100000:3.0:1790656714.945858:0:16543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+11:2340:x1877639248866944:12345-192.168.203.23@tcp:4:dd.0 Request processed in 133889us (189809us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790656714.945869:0:16543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1790656714.945916:0:16543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1790656714.945930:0:16543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+10:2340:x1877639248867072:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656714.945961:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945973:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.945978:0:16543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656714.945983:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656714.945995:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790656715.011739:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1790656715.012205:0:15004:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1790656715.012210:0:15004:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1790656715.012223:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012236:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012246:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012264:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97800 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:3.0:1790656715.012268:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012277:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012297:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012304:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e95dec8/0x9c3a6e82066ec1b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790656715.012397:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+10:2340:x1877639248866816:12345-192.168.203.23@tcp:4:dd.0 Request processed in 128259us (256325us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790656715.012406:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1790656715.012443:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1790656715.012454:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+9:2339:x1877639248867200:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:3.0:1790656715.012483:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012495:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656715.012499:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790656715.012504:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790656715.012528:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790656715.068067:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1790656715.069028:0:16543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1790656715.069047:0:16543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069061:0:16543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069071:0:16543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069080:0:16543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c97200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:0.0:1790656715.069084:0:16543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069094:0:16543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069115:0:16543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790656715.069139:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc67c89/0x9c3a6e82066ec1be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790656715.069257:0:16543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e04176dd-0835-45f2-9651-67d83fe9deba+9:2340:x1877639248867072:12345-192.168.203.23@tcp:4:dd.0 Request processed in 123329us (313161us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790656715.069267:0:16543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000001:00080000:1.0:1790656715.106198:0:6716:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1790656715.106348:0:15004:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1790656715.106364:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106376:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106384:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106392:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943907c96200 already unused, calling callback (ffffffffc16cb900) 00010000:00010000:2.0:1790656715.106397:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106405:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106498:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790656715.106508:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009530c292/0x9c3a6e82066ec1c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790656715.106812:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e04176dd-0835-45f2-9651-67d83fe9deba+5:2339:x1877639248867200:12345-192.168.203.23@tcp:4:dd.0 Request processed in 94356us (350697us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790656715.106823:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00010000:00010000:0.0:1790656715.614875:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790656716.027856:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.027898:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.027919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.027960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.027987:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.028009:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.028032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1790656716.028061:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867328 00000100:00100000:3.0:1790656716.028071:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867328 00000100:00100000:0.0:1790656716.028208:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867456 00000100:00100000:0.0:1790656716.028213:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867456 00000100:00100000:0.0:1790656716.028247:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867840 00000100:00100000:0.0:1790656716.028250:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867840 00000100:00100000:0.0:1790656716.028266:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1790656716.028274:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+20:2340:x1877639248867456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028346:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e04176dd-0835-45f2-9651-67d83fe9deba+20:2340:x1877639248867456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 73us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028353:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1790656716.028368:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1790656716.028386:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2340:x1877639248867840:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028410:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29780b47-b3ec-4efd-87cc-984c89843686+6:2340:x1877639248867840:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028415:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00080000:0.0:1790656716.028439:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790656716.028559:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867712 00000100:00100000:0.0:1790656716.028562:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867712 00000100:00100000:0.0:1790656716.028582:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867968 00000100:00100000:0.0:1790656716.028627:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867968 00000100:00100000:0.0:1790656716.028643:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248867584 00000100:00100000:0.0:1790656716.028645:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248867584 00000100:00100000:0.0:1790656716.028657:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639248868096 00000100:00100000:0.0:1790656716.028659:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639248868096 00000100:00100000:0.0:1790656716.028673:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1790656716.028679:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248867712:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028730:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248867712:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028737:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1790656716.028749:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1790656716.028755:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248867968:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028774:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248867968:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 20us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028780:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1790656716.028788:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1790656716.028793:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248867584:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028809:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e04176dd-0835-45f2-9651-67d83fe9deba+5:2340:x1877639248867584:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 15us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028814:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1790656716.028822:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1790656716.028827:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248868096:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028842:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff943935264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29780b47-b3ec-4efd-87cc-984c89843686+5:2340:x1877639248868096:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 15us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028847:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00080000:0.0:1790656716.028865:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790656716.028867:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790656716.028886:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:0.0:1790656716.028893:0:14308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393b9e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2340:x1877639248867328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1790656716.028914:0:14308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393b9e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2c7c86-2ba2-4fa5-bdc1-e1f09552f676+13:2340:x1877639248867328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790656716.028919:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000001:02000400:0.0:1790656716.581671:0:16582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1790656716.638918:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790656716.959121:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff943935265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790656716.959206:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790656716.959398:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877639269817216 00000100:00100000:2.0:1790656716.959407:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877639269817216 00000100:00100000:2.0:1790656716.959490:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656716.959500:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269817216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790656716.959535:0:15001:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790656716.959583:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94393f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877639269817216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790656716.959609:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790656716.959646:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1790656716.959651:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94391f5a1f80, transno 8589934595 00000004:00080000:2.0:1790656716.959661:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1790656716.959687:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff943935265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1877639269817216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790656716.960617:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790656717.662895:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29079 lines, 29079 kept, 0 dropped, 0 bad.